Jul 28 12:29:51.278245 ip-10-0-128-176 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 12:29:51.662592 ip-10-0-128-176 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 12:29:51.662592 ip-10-0-128-176 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 12:29:51.662592 ip-10-0-128-176 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 12:29:51.662592 ip-10-0-128-176 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 12:29:51.662592 ip-10-0-128-176 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 12:29:51.664425 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.664270    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 12:29:51.672852 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672831    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:29:51.672852 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672848    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:29:51.672852 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672852    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:29:51.672852 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672855    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:29:51.672852 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672858    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672862    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672864    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672867    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672870    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672872    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672875    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672878    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672880    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672883    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672886    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672888    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672891    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672894    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672896    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672905    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672909    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672912    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672915    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:29:51.673071 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672918    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672920    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672923    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672925    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672928    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672932    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672935    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672938    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672941    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672944    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672947    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672949    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672952    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672954    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672957    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672960    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672963    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672966    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672968    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672971    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:29:51.673520 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672973    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672991    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672994    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672997    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.672999    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673002    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673004    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673006    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673009    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673012    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673014    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673017    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673019    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673021    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673024    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673027    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673031    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673033    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673036    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673038    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:29:51.674046 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673041    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673043    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673046    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673048    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673051    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673053    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673056    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673060    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673062    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673065    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673068    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673071    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673073    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673076    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673078    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673081    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673084    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673086    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673088    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673091    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:29:51.674542 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673094    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673097    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673099    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673102    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673104    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673107    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673109    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673112    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673114    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673117    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673119    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673122    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673124    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673127    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673129    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673132    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673788    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673794    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673796    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673799    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:29:51.675032 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673803    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673805    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673808    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673810    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673813    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673815    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673818    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673820    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673823    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673825    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673828    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673830    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673833    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673836    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673838    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673841    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673843    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673846    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673848    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673851    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:29:51.675495 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673853    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673856    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673860    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673864    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673867    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673870    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673873    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673876    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673878    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673881    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673884    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673887    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673890    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673893    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673895    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673898    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673900    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673903    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673905    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:29:51.675997 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673908    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673910    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673912    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673915    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673918    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673922    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673924    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673927    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673930    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673933    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673935    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673938    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673941    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673943    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673945    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673948    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673950    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673952    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673955    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673958    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:29:51.676560 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673960    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673963    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673965    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673968    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673970    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673973    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673993    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673996    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.673999    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674003    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674005    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674008    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674010    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674012    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674015    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674017    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674020    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674022    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674025    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674027    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:29:51.677074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674030    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674035    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674037    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674040    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674043    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674045    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674048    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674050    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674053    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674057    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674061    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674064    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674067    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674069    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674072    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674075    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674458    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674463    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674466    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674469    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:29:51.677585 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674471    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674474    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674477    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674479    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674482    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674484    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674486    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674489    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674493    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674496    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674500    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674504    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674508    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674512    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674515    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674517    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674520    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674523    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674527    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:29:51.678104 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674530    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674533    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674536    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674538    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674540    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674543    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674545    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674548    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674551    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674554    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674556    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674559    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674561    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674564    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674567    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674569    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674572    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674574    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674576    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674579    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:29:51.678577 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674581    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674583    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674586    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674589    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674592    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674594    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674598    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674600    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674603    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674605    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674607    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674610    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674613    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674615    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674617    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674620    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674622    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674625    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674629    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:29:51.679074 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674631    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674634    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674636    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674638    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674641    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674643    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674646    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674648    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674651    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674653    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674657    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674660    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674662    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674665    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674667    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674669    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674672    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674674    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674676    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674679    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:29:51.679568 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674688    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674691    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674694    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674696    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674698    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674700    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674703    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674705    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674708    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674710    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674713    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674718    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674720    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674723    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674725    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674728    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.674730    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674794    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674801    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674813    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674817    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 12:29:51.680053 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674821    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674824    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674828    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674831    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674834    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674837    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674840    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674843    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674846    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674849    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674852    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674855    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674858    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674861    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674865    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674867    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674871    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674873    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674877    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674880    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674883    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674885    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674890    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674892    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 12:29:51.680559 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674895    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674898    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674901    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674903    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674907    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674910    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674913    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674915    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674918    2565 flags.go:64] FLAG: --enable-server="true"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674921    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674925    2565 flags.go:64] FLAG: --event-burst="100"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674928    2565 flags.go:64] FLAG: --event-qps="50"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674931    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674934    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674936    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674941    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674943    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674946    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674949    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674952    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674955    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674958    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674961    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674964    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674967    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 12:29:51.681184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674969    2565 flags.go:64] FLAG: --feature-gates=""
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674973    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674989    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674992    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.674995    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675000    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675002    2565 flags.go:64] FLAG: --help="false"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675005    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-128-176.ec2.internal"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675008    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675011    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675014    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675017    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675020    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675023    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675026    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675028    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675031    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675036    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675039    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675041    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675044    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675047    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675050    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675052    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 12:29:51.681805 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675055    2565 flags.go:64] FLAG: --lock-file=""
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675057    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675060    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675063    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675068    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675071    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675074    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675077    2565 flags.go:64] FLAG: --logging-format="text"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675079    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675082    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675085    2565 flags.go:64] FLAG: --manifest-url=""
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675087    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675091    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675096    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675100    2565 flags.go:64] FLAG: --max-pods="110"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675103    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675106    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675108    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675111    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675114    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675117    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675120    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675127    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675130    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675132    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 12:29:51.682429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675139    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675142    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675147    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675150    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675153    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675156    2565 flags.go:64] FLAG: --port="10250"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675158    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675161    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c8f760e167323b88"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675164    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675167    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675170    2565 flags.go:64] FLAG: --register-node="true"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675172    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675176    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675179    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675182    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675185    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675188    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675191    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675194    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675196    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675199    2565 flags.go:64] FLAG: --runonce="false"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675202    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675205    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675208    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675211    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 12:29:51.683051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675214    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675216    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675220    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675222    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675225    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675228    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675230    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675234    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675237    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675240    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675242    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675247    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675250    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675252    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675256    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675259    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675261    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675264    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675266    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675269    2565 flags.go:64] FLAG: --v="2"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675272    2565 flags.go:64] FLAG: --version="false"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675277    2565 flags.go:64] FLAG: --vmodule=""
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675280    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.675283    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675390    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:29:51.683642 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675393    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675395    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675398    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675402    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675404    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675407    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675409    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675412    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675414    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675417    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675419    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675422    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675424    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675426    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675430    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675433    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675435    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675437    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675440    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675442    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:29:51.684750 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675444    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675447    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675449    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675451    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675454    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675456    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675458    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675461    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675463    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675466    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675469    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675471    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675474    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675477    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675481    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675484    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675487    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675490    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675493    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675495    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:29:51.685252 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675498    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675500    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675503    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675505    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675507    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675510    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675514    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675516    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675519    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675521    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675525    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675528    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675531    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675534    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675536    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675539    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675541    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675544    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675546    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675549    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:29:51.685731 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675551    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675553    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675556    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675559    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675562    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675564    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675567    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675570    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675573    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675575    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675577    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675580    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675582    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675585    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675587    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675589    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675592    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675594    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675598    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:29:51.686243 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675601    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675603    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675605    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675608    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675610    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675613    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675615    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675618    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675620    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675622    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675625    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675627    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675630    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675633    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675635    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675637    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675640    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675644    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:29:51.686705 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.675647    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.676280    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.682952    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.682968    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.683999    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.684006    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684065    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684069    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684074    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684077    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684079    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684082    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684084    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684087    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684089    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:29:51.687163 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684092    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684094    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684097    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684099    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684102    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684105    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684108    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684110    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684113    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684116    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684119    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684121    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684123    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684126    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684128    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684131    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684133    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684135    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684138    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684141    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:29:51.687532 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684144    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684146    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684149    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684152    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684154    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684156    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684159    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684161    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684163    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684166    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684168    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684171    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684173    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684175    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684178    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684180    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684183    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684185    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684187    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684190    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:29:51.688017 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684192    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684195    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684198    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684200    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684203    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684205    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684208    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684210    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684213    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684217    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684221    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684224    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684227    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684231    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684234    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684236    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684239    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684241    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684244    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:29:51.688493 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684246    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684249    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684251    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684254    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684256    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684258    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684261    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684263    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684266    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684268    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684271    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684274    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684276    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684278    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684281    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684283    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684286    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684288    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684291    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684293    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684295    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:29:51.688948 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684298    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684301    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684304    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684306    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684310    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684313    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684317    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684320    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684323    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684327    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.684332    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684459    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684464    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684466    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:29:51.689472 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684469    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684471    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684474    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684476    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684479    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684482    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684484    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684486    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684489    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684491    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684494    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684496    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684499    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684501    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684503    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684506    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684508    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684510    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684513    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684515    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:29:51.689830 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684517    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684520    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684522    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684525    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684527    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684534    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684537    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684540    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684542    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684544    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684546    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684549    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684551    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684553    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684556    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684558    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684561    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684563    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684566    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:29:51.690360 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684568    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684570    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684573    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684575    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684577    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684579    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684582    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684584    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684586    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684588    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684591    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684593    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684596    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684598    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684600    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684603    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684605    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684609    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684612    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:29:51.690827 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684622    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684626    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684630    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684632    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684635    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684638    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684640    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684643    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684646    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684648    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684651    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684653    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684655    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684658    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684660    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684662    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684665    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684667    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684670    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684672    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:29:51.691469 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684675    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684677    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684679    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684682    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684684    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684686    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684690    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684693    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684696    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684699    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684701    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684704    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684707    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684714    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684717    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684720    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684722    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:29:51.692228 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:51.684724    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:29:51.692710 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.684729    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 12:29:51.692710 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.684847    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 12:29:51.692710 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.686682    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 12:29:51.692710 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.687855    2565 server.go:1019] "Starting client certificate rotation"
Jul 28 12:29:51.692710 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.687955    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 12:29:51.692710 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.688001    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 12:29:51.692710 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.690154    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 12:29:51.697161 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.697141    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 12:29:51.708332 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.708316    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 28 12:29:51.710754 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.710740    2565 log.go:25] "Validated CRI v1 image API"
Jul 28 12:29:51.712616 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.712598    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 12:29:51.714822 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.714806    2565 fs.go:135] Filesystem UUIDs: map[0a85fef1-cf38-42ac-bf1b-a1c84504f0ba:/dev/nvme0n1p3 25f296d2-6ddd-4d0b-afcf-4eea9727dd8f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 28 12:29:51.714868 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.714823    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 12:29:51.720326 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.720209    2565 manager.go:216] Machine: {Timestamp:2026-07-28 12:29:51.719021212 +0000 UTC m=+0.328886910 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3227384 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28c9819b6d7859917a2ef51a4db7b3 SystemUUID:ec28c981-9b6d-7859-917a-2ef51a4db7b3 BootID:4846095d-7346-4b98-834b-8b989c750738 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:95:5d:2c:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:95:5d:2c:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:01:1a:b8:36:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 12:29:51.720326 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.720317    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 12:29:51.720466 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.720397    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 12:29:51.723382 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.723350    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 12:29:51.723530 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.723386    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-176.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 12:29:51.724818 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.724807    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 12:29:51.724873 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.724820    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 12:29:51.724873 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.724831    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 12:29:51.725030 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.725011    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 12:29:51.725728 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.725715    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 12:29:51.726819 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.726809    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 12:29:51.730260 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.730249    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 12:29:51.730387 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.730377    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 12:29:51.730432 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.730411    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 12:29:51.730432 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.730421    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 12:29:51.730432 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.730432    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 12:29:51.730532 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.730441    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 28 12:29:51.730532 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.730449    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 12:29:51.730822 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.730811    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 12:29:51.730859 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.730836    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 12:29:51.733251 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.733232    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 12:29:51.734423 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.734410    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 12:29:51.734469 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.734440    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 12:29:51.735095 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735085    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 12:29:51.735145 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735101    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 12:29:51.735145 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735107    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 12:29:51.735145 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735112    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 12:29:51.735145 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735120    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 12:29:51.735145 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735125    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 12:29:51.735145 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735133    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 12:29:51.735145 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735138    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 12:29:51.735360 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735150    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 12:29:51.735360 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735155    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 12:29:51.735360 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735163    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 12:29:51.735360 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735171    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 12:29:51.735876 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735867    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 12:29:51.735876 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.735875    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 12:29:51.738960 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.738946    2565 server.go:1268] "Started kubelet"
Jul 28 12:29:51.739095 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.739048    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 12:29:51.739151 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.739104    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 12:29:51.739187 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.739178    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 12:29:51.743424 ip-10-0-128-176 systemd[1]: Started Kubernetes Kubelet.
Jul 28 12:29:51.744242 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.743496    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 12:29:51.745189 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.745167    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 12:29:51.745842 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.745824    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 12:29:51.746959 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.746941    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-176.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 12:29:51.747417 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.747394    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-176.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 12:29:51.747466 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.747391    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 12:29:51.750589 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.749773    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-176.ec2.internal.18c673f372c7c0eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-176.ec2.internal,UID:ip-10-0-128-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-176.ec2.internal,},FirstTimestamp:2026-07-28 12:29:51.738921195 +0000 UTC m=+0.348786892,LastTimestamp:2026-07-28 12:29:51.738921195 +0000 UTC m=+0.348786892,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-176.ec2.internal,}"
Jul 28 12:29:51.751283 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.751270    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 12:29:51.751357 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.751290    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 12:29:51.751409 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.751391    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:51.751822 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.751806    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 12:29:51.751940 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.751927    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 12:29:51.752025 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.751802    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 12:29:51.752089 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.752076    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 12:29:51.752089 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.752084    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 12:29:51.752187 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.752094    2565 factory.go:55] Registering systemd factory
Jul 28 12:29:51.752187 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.752110    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 28 12:29:51.752385 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.752358    2565 factory.go:153] Registering CRI-O factory
Jul 28 12:29:51.752385 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.752376    2565 factory.go:223] Registration of the crio container factory successfully
Jul 28 12:29:51.752528 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.752450    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 12:29:51.752528 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.752475    2565 factory.go:103] Registering Raw factory
Jul 28 12:29:51.752528 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.752491    2565 manager.go:1196] Started watching for new ooms in manager
Jul 28 12:29:51.753284 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.753267    2565 manager.go:349] Starting recovery of all containers
Jul 28 12:29:51.756942 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.756920    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-176.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 12:29:51.757062 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.757034    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 12:29:51.763258 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.763242    2565 manager.go:354] Recovery completed
Jul 28 12:29:51.767299 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.767287    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:29:51.769193 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.769174    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:29:51.769286 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.769215    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:29:51.769286 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.769231    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:29:51.769801 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.769788    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 12:29:51.769801 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.769800    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 12:29:51.769897 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.769816    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 12:29:51.769897 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.769819    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:29:51.770508 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.770494    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:29:51.770574 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.770522    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:29:51.770574 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.770535    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:29:51.771529 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.771448    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-176.ec2.internal.18c673f37495acab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-176.ec2.internal,UID:ip-10-0-128-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-176.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-176.ec2.internal,},FirstTimestamp:2026-07-28 12:29:51.769193643 +0000 UTC m=+0.379059345,LastTimestamp:2026-07-28 12:29:51.769193643 +0000 UTC m=+0.379059345,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-176.ec2.internal,}"
Jul 28 12:29:51.771779 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.771768    2565 policy_none.go:49] "None policy: Start"
Jul 28 12:29:51.771820 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.771785    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 12:29:51.771820 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.771795    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 12:29:51.774664 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.774648    2565 policy_none.go:47] "Start"
Jul 28 12:29:51.783907 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.783723    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-176.ec2.internal.18c673f374961b80  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-176.ec2.internal,UID:ip-10-0-128-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-176.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-176.ec2.internal,},FirstTimestamp:2026-07-28 12:29:51.769222016 +0000 UTC m=+0.379087718,LastTimestamp:2026-07-28 12:29:51.769222016 +0000 UTC m=+0.379087718,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-176.ec2.internal,}"
Jul 28 12:29:51.793529 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.793462    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-176.ec2.internal.18c673f37496551a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-176.ec2.internal,UID:ip-10-0-128-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-176.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-176.ec2.internal,},FirstTimestamp:2026-07-28 12:29:51.769236762 +0000 UTC m=+0.379102461,LastTimestamp:2026-07-28 12:29:51.769236762 +0000 UTC m=+0.379102461,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-176.ec2.internal,}"
Jul 28 12:29:51.809309 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.809241    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-176.ec2.internal.18c673f37495acab\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-176.ec2.internal.18c673f37495acab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-176.ec2.internal,UID:ip-10-0-128-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-176.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-176.ec2.internal,},FirstTimestamp:2026-07-28 12:29:51.769193643 +0000 UTC m=+0.379059345,LastTimestamp:2026-07-28 12:29:51.770508081 +0000 UTC m=+0.380373779,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-176.ec2.internal,}"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.809602    2565 manager.go:337] "Starting Device Plugin manager"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.809639    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.809652    2565 server.go:87] "Starting device plugin registration server"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.809896    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.809907    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.810086    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.810167    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.810177    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.810692    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.810744    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.820410    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-176.ec2.internal.18c673f374961b80\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-176.ec2.internal.18c673f374961b80  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-176.ec2.internal,UID:ip-10-0-128-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-176.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-176.ec2.internal,},FirstTimestamp:2026-07-28 12:29:51.769222016 +0000 UTC m=+0.379087718,LastTimestamp:2026-07-28 12:29:51.77052823 +0000 UTC m=+0.380393928,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-176.ec2.internal,}"
Jul 28 12:29:51.835844 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.830343    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-176.ec2.internal.18c673f37496551a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-176.ec2.internal.18c673f37496551a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-176.ec2.internal,UID:ip-10-0-128-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-176.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-176.ec2.internal,},FirstTimestamp:2026-07-28 12:29:51.769236762 +0000 UTC m=+0.379102461,LastTimestamp:2026-07-28 12:29:51.770539041 +0000 UTC m=+0.380404739,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-176.ec2.internal,}"
Jul 28 12:29:51.843145 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.843083    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-176.ec2.internal.18c673f37722d85c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-176.ec2.internal,UID:ip-10-0-128-176.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-128-176.ec2.internal,},FirstTimestamp:2026-07-28 12:29:51.811999836 +0000 UTC m=+0.421865525,LastTimestamp:2026-07-28 12:29:51.811999836 +0000 UTC m=+0.421865525,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-176.ec2.internal,}"
Jul 28 12:29:51.883960 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.883931    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qvjgn"
Jul 28 12:29:51.891811 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.891775    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 12:29:51.893197 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.893165    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 12:29:51.893293 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.893208    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 12:29:51.893293 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.893231    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 12:29:51.893293 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.893274    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 12:29:51.894379 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.894325    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qvjgn"
Jul 28 12:29:51.905526 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.905508    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:29:51.910492 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.910481    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:29:51.911252 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.911237    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:29:51.911308 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.911270    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:29:51.911308 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.911283    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:29:51.911308 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.911306    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-176.ec2.internal"
Jul 28 12:29:51.921032 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.920969    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-176.ec2.internal"
Jul 28 12:29:51.921032 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.921004    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-176.ec2.internal\": node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:51.955697 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:51.955677    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:51.993769 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.993728    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal"]
Jul 28 12:29:51.993903 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.993808    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:29:51.995317 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.995303    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:29:51.995405 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.995335    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:29:51.995405 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.995348    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:29:51.997382 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.997367    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:29:51.997539 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.997522    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:51.997600 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.997558    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:29:51.998197 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.998180    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:29:51.998287 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.998209    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:29:51.998287 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.998223    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:29:51.998287 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.998237    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:29:51.998287 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.998255    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:29:51.998287 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:51.998263    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:29:52.000183 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.000168    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.000293 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.000201    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:29:52.000922 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.000906    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:29:52.001006 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.000938    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:29:52.001006 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.000953    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:29:52.028514 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:52.028496    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-176.ec2.internal\" not found" node="ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.032900 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:52.032883    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-176.ec2.internal\" not found" node="ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.056225 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:52.056208    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:52.153274 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.153246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ce9148be59f873fc772478b9a59c1fc-config\") pod \"kube-apiserver-proxy-ip-10-0-128-176.ec2.internal\" (UID: \"2ce9148be59f873fc772478b9a59c1fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.153274 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.153274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8955737c646d62b1a879d1f772616067-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal\" (UID: \"8955737c646d62b1a879d1f772616067\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.153451 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.153292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8955737c646d62b1a879d1f772616067-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal\" (UID: \"8955737c646d62b1a879d1f772616067\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.157245 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:52.157227    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:52.254379 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.254355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ce9148be59f873fc772478b9a59c1fc-config\") pod \"kube-apiserver-proxy-ip-10-0-128-176.ec2.internal\" (UID: \"2ce9148be59f873fc772478b9a59c1fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.254485 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.254390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8955737c646d62b1a879d1f772616067-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal\" (UID: \"8955737c646d62b1a879d1f772616067\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.254485 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.254407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8955737c646d62b1a879d1f772616067-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal\" (UID: \"8955737c646d62b1a879d1f772616067\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.254485 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.254445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8955737c646d62b1a879d1f772616067-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal\" (UID: \"8955737c646d62b1a879d1f772616067\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.254485 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.254469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ce9148be59f873fc772478b9a59c1fc-config\") pod \"kube-apiserver-proxy-ip-10-0-128-176.ec2.internal\" (UID: \"2ce9148be59f873fc772478b9a59c1fc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.254614 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.254469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8955737c646d62b1a879d1f772616067-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal\" (UID: \"8955737c646d62b1a879d1f772616067\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.257461 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:52.257443    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:52.330669 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.330642    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.335844 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.335525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.358017 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:52.357994    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:52.458525 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:52.458493    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:52.559062 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:52.559001    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:52.659503 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:52.659481    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:52.666238 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.666222    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:29:52.687565 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.687537    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 12:29:52.687676 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.687653    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 12:29:52.687714 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.687653    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 12:29:52.760493 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:52.760462    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-176.ec2.internal\" not found"
Jul 28 12:29:52.773218 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.773198    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:29:52.779867 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.779849    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:29:52.852037 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.852005    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.874073 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.874050    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 12:29:52.874730 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.874714    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal"
Jul 28 12:29:52.885747 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.885731    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 12:29:52.898513 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.898476    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 12:24:52 +0000 UTC" deadline="2028-02-06 22:51:33.822597122 +0000 UTC"
Jul 28 12:29:52.898513 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.898504    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13402h21m40.924095656s"
Jul 28 12:29:52.956606 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:52.956557    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce9148be59f873fc772478b9a59c1fc.slice/crio-79ee91fbacb6de0fc273d4f1e400658b289278b44467636b7ccf08b6ef71c2a1 WatchSource:0}: Error finding container 79ee91fbacb6de0fc273d4f1e400658b289278b44467636b7ccf08b6ef71c2a1: Status 404 returned error can't find the container with id 79ee91fbacb6de0fc273d4f1e400658b289278b44467636b7ccf08b6ef71c2a1
Jul 28 12:29:52.956814 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:52.956795    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8955737c646d62b1a879d1f772616067.slice/crio-8b15a4d276566c25861e54fb378c6bff4cca7bc7538e5e031bb499549995828d WatchSource:0}: Error finding container 8b15a4d276566c25861e54fb378c6bff4cca7bc7538e5e031bb499549995828d: Status 404 returned error can't find the container with id 8b15a4d276566c25861e54fb378c6bff4cca7bc7538e5e031bb499549995828d
Jul 28 12:29:52.964967 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:52.964947    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 12:29:53.731347 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.731313    2565 apiserver.go:52] "Watching apiserver"
Jul 28 12:29:53.737552 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.737517    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 12:29:53.738553 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.738523    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-k4l99","kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq","openshift-dns/node-resolver-wgj9h","openshift-image-registry/node-ca-b8f4r","openshift-multus/multus-additional-cni-plugins-pwj5s","openshift-network-diagnostics/network-check-target-vhnqh","openshift-network-operator/iptables-alerter-9vn6l","kube-system/global-pull-secret-syncer-tdmcg","openshift-cluster-node-tuning-operator/tuned-mvck8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal","openshift-multus/multus-4jc6z","openshift-multus/network-metrics-daemon-l9cdv","openshift-ovn-kubernetes/ovnkube-node-kgvqt"]
Jul 28 12:29:53.741418 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.741392    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:29:53.741525 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.741481    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:29:53.743826 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.743809    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:53.743945 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.743876    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:29:53.748328 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.747535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.749284 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.748769    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:53.752821 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.750560    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-whbjj\""
Jul 28 12:29:53.752821 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.750751    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 12:29:53.752821 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.750990    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 12:29:53.752821 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.751209    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 12:29:53.752821 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.751514    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 12:29:53.752821 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.751560    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xmdhq\""
Jul 28 12:29:53.752821 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.751693    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 12:29:53.752821 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.751768    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 12:29:53.752821 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.751959    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:53.755335 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.755007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.758496 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.756047    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4j87x\""
Jul 28 12:29:53.758496 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.756191    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 12:29:53.758496 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.756413    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 12:29:53.758496 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.756919    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 12:29:53.758496 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.757470    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 12:29:53.758496 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.757717    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 12:29:53.758496 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.758013    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 12:29:53.758496 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.758121    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:53.758496 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.758199    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:29:53.758496 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.758291    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bzb22\""
Jul 28 12:29:53.759100 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.759046    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 12:29:53.759404 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.759384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:29:53.760488 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8cpd\" (UniqueName: \"kubernetes.io/projected/00ead778-8308-459e-9361-5091cc6b8849-kube-api-access-c8cpd\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:53.760601 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760503    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.760601 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-device-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.760601 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4f78aa3-8acd-41e7-8cc4-2e33c3938634-host\") pod \"node-ca-b8f4r\" (UID: \"e4f78aa3-8acd-41e7-8cc4-2e33c3938634\") " pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:53.760601 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4f78aa3-8acd-41e7-8cc4-2e33c3938634-serviceca\") pod \"node-ca-b8f4r\" (UID: \"e4f78aa3-8acd-41e7-8cc4-2e33c3938634\") " pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:53.760810 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qmlf\" (UniqueName: \"kubernetes.io/projected/e4f78aa3-8acd-41e7-8cc4-2e33c3938634-kube-api-access-4qmlf\") pod \"node-ca-b8f4r\" (UID: \"e4f78aa3-8acd-41e7-8cc4-2e33c3938634\") " pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:53.760810 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-os-release\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.760810 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16196fd0-ecdf-4771-bceb-f196876d7d8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.760810 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr5k7\" (UniqueName: \"kubernetes.io/projected/16196fd0-ecdf-4771-bceb-f196876d7d8b-kube-api-access-rr5k7\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.760810 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-etc-selinux\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.760810 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760724    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6622717-f1dd-4632-8535-16a44cceb950-hosts-file\") pod \"node-resolver-wgj9h\" (UID: \"c6622717-f1dd-4632-8535-16a44cceb950\") " pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:53.760810 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760746    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-system-cni-dir\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.760810 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-cnibin\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.760810 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-socket-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.761269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.761269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16196fd0-ecdf-4771-bceb-f196876d7d8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.761269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-registration-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.761269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-sys-fs\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.761269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmt9t\" (UniqueName: \"kubernetes.io/projected/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-kube-api-access-fmt9t\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.761269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.760977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6622717-f1dd-4632-8535-16a44cceb950-tmp-dir\") pod \"node-resolver-wgj9h\" (UID: \"c6622717-f1dd-4632-8535-16a44cceb950\") " pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:53.761269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.761001    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncfs4\" (UniqueName: \"kubernetes.io/projected/c6622717-f1dd-4632-8535-16a44cceb950-kube-api-access-ncfs4\") pod \"node-resolver-wgj9h\" (UID: \"c6622717-f1dd-4632-8535-16a44cceb950\") " pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:53.761269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.761056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16196fd0-ecdf-4771-bceb-f196876d7d8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.761269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.761083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqgmb\" (UniqueName: \"kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb\") pod \"network-check-target-vhnqh\" (UID: \"8cefad0d-fd11-401d-aee3-8ba97afa3268\") " pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:29:53.761269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.761108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:53.762018 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.761973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.762667 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.762650    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 12:29:53.762767 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.762712    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gj5rb\""
Jul 28 12:29:53.762899 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.762883    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 12:29:53.763228 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.763208    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 12:29:53.765041 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.764977    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.772726 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.772703    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 12:29:53.773054 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.773035    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 12:29:53.773355 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.773340    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 12:29:53.773631 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.773615    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 12:29:53.774216 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.774188    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 12:29:53.774307 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.774268    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 12:29:53.775617 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.775156    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mlvwk\""
Jul 28 12:29:53.775617 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.775310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8678p\""
Jul 28 12:29:53.775617 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.775504    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 12:29:53.776507 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.776486    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:29:53.777554 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.776899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:53.779373 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.779355    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.782551 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.781790    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 12:29:53.782551 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.781986    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 12:29:53.782551 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.782270    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5chlh\""
Jul 28 12:29:53.782551 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.782482    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:29:53.783093 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.783032    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 12:29:53.783273 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.783256    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vqb5p\""
Jul 28 12:29:53.784023 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.783998    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 12:29:53.804917 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.804860    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5br96"
Jul 28 12:29:53.816364 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.816339    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5br96"
Jul 28 12:29:53.853170 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.853146    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 12:29:53.861536 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3175b78-5a24-45b8-9414-31298cd5e9ce-cni-binary-copy\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.861611 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/736215d4-1e7e-422b-b6df-0ccb207e10e7-agent-certs\") pod \"konnectivity-agent-k4l99\" (UID: \"736215d4-1e7e-422b-b6df-0ccb207e10e7\") " pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:29:53.861611 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-var-lib-openvswitch\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.861686 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6eea981-39ec-4377-ab70-966c59ff1651-ovnkube-script-lib\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.861686 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-var-lib-kubelet\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.861686 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.861778 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-modprobe-d\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.861778 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-tuned\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.861778 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-socket-dir-parent\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.861880 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-kubelet\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.861916 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16196fd0-ecdf-4771-bceb-f196876d7d8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.861946 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2-iptables-alerter-script\") pod \"iptables-alerter-9vn6l\" (UID: \"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2\") " pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:53.861979 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861954    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-var-lib-kubelet\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.862012 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.861979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-etc-kubernetes\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.862099 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksx7x\" (UniqueName: \"kubernetes.io/projected/e3175b78-5a24-45b8-9414-31298cd5e9ce-kube-api-access-ksx7x\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.862099 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qmlf\" (UniqueName: \"kubernetes.io/projected/e4f78aa3-8acd-41e7-8cc4-2e33c3938634-kube-api-access-4qmlf\") pod \"node-ca-b8f4r\" (UID: \"e4f78aa3-8acd-41e7-8cc4-2e33c3938634\") " pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:53.862099 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-run-systemd\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.862199 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-etc-openvswitch\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.862199 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-sys\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.862199 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-cnibin\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.862292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-daemon-config\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.862292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-run-multus-certs\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.862292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-system-cni-dir\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.862383 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-cnibin\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.862383 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-log-socket\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.862383 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6eea981-39ec-4377-ab70-966c59ff1651-ovnkube-config\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.862383 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-host\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.862495 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-dbus\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:53.862495 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.862495 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-cni-netd\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.862495 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6eea981-39ec-4377-ab70-966c59ff1651-ovn-node-metrics-cert\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.862495 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-kubernetes\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.862697 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-kubelet-config\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:53.862697 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-etc-selinux\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.862697 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8cpd\" (UniqueName: \"kubernetes.io/projected/00ead778-8308-459e-9361-5091cc6b8849-kube-api-access-c8cpd\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:53.862697 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.862697 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-device-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.862697 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-run-netns\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.862697 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tclt\" (UniqueName: \"kubernetes.io/projected/d6eea981-39ec-4377-ab70-966c59ff1651-kube-api-access-9tclt\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.862697 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-system-cni-dir\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.862697 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-cni-dir\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-os-release\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16196fd0-ecdf-4771-bceb-f196876d7d8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr5k7\" (UniqueName: \"kubernetes.io/projected/16196fd0-ecdf-4771-bceb-f196876d7d8b-kube-api-access-rr5k7\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-node-log\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-run\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-lib-modules\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-var-lib-cni-bin\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-hostroot\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-socket-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-slash\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.862962 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.862980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/736215d4-1e7e-422b-b6df-0ccb207e10e7-konnectivity-ca\") pod \"konnectivity-agent-k4l99\" (UID: \"736215d4-1e7e-422b-b6df-0ccb207e10e7\") " pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-registration-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863025    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6622717-f1dd-4632-8535-16a44cceb950-tmp-dir\") pod \"node-resolver-wgj9h\" (UID: \"c6622717-f1dd-4632-8535-16a44cceb950\") " pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-run-ovn\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-sysconfig\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgmb\" (UniqueName: \"kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb\") pod \"network-check-target-vhnqh\" (UID: \"8cefad0d-fd11-401d-aee3-8ba97afa3268\") " pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-run-openvswitch\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-cni-bin\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4175ed56-a41f-4b06-8a6e-e1e63390e490-tmp\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-var-lib-cni-multus\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4f78aa3-8acd-41e7-8cc4-2e33c3938634-host\") pod \"node-ca-b8f4r\" (UID: \"e4f78aa3-8acd-41e7-8cc4-2e33c3938634\") " pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4f78aa3-8acd-41e7-8cc4-2e33c3938634-serviceca\") pod \"node-ca-b8f4r\" (UID: \"e4f78aa3-8acd-41e7-8cc4-2e33c3938634\") " pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863256    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6622717-f1dd-4632-8535-16a44cceb950-hosts-file\") pod \"node-resolver-wgj9h\" (UID: \"c6622717-f1dd-4632-8535-16a44cceb950\") " pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-sysctl-d\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bxch\" (UniqueName: \"kubernetes.io/projected/8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2-kube-api-access-8bxch\") pod \"iptables-alerter-9vn6l\" (UID: \"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2\") " pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:53.863460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-run-k8s-cni-cncf-io\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-run-netns\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-os-release\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16196fd0-ecdf-4771-bceb-f196876d7d8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-sys-fs\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmt9t\" (UniqueName: \"kubernetes.io/projected/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-kube-api-access-fmt9t\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-systemd-units\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbhkt\" (UniqueName: \"kubernetes.io/projected/4175ed56-a41f-4b06-8a6e-e1e63390e490-kube-api-access-xbhkt\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-conf-dir\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncfs4\" (UniqueName: \"kubernetes.io/projected/c6622717-f1dd-4632-8535-16a44cceb950-kube-api-access-ncfs4\") pod \"node-resolver-wgj9h\" (UID: \"c6622717-f1dd-4632-8535-16a44cceb950\") " pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2-host-slash\") pod \"iptables-alerter-9vn6l\" (UID: \"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2\") " pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6eea981-39ec-4377-ab70-966c59ff1651-env-overrides\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-sysctl-conf\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-systemd\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.863877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-registration-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864062    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-cnibin\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.864304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c6622717-f1dd-4632-8535-16a44cceb950-tmp-dir\") pod \"node-resolver-wgj9h\" (UID: \"c6622717-f1dd-4632-8535-16a44cceb950\") " pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-device-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-os-release\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-etc-selinux\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/16196fd0-ecdf-4771-bceb-f196876d7d8b-system-cni-dir\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-sys-fs\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864479    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-socket-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864551    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4f78aa3-8acd-41e7-8cc4-2e33c3938634-host\") pod \"node-ca-b8f4r\" (UID: \"e4f78aa3-8acd-41e7-8cc4-2e33c3938634\") " pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/16196fd0-ecdf-4771-bceb-f196876d7d8b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.864579    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864627    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c6622717-f1dd-4632-8535-16a44cceb950-hosts-file\") pod \"node-resolver-wgj9h\" (UID: \"c6622717-f1dd-4632-8535-16a44cceb950\") " pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.864647    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs podName:00ead778-8308-459e-9361-5091cc6b8849 nodeName:}" failed. No retries permitted until 2026-07-28 12:29:54.36462331 +0000 UTC m=+2.974488999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs") pod "network-metrics-daemon-l9cdv" (UID: "00ead778-8308-459e-9361-5091cc6b8849") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864645    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/16196fd0-ecdf-4771-bceb-f196876d7d8b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.865139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.864939    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4f78aa3-8acd-41e7-8cc4-2e33c3938634-serviceca\") pod \"node-ca-b8f4r\" (UID: \"e4f78aa3-8acd-41e7-8cc4-2e33c3938634\") " pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:53.865626 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.865173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/16196fd0-ecdf-4771-bceb-f196876d7d8b-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.877656 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.877466    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 12:29:53.880239 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.880218    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:29:53.880417 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.880251    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:29:53.880417 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.880266    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nqgmb for pod openshift-network-diagnostics/network-check-target-vhnqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:29:53.880417 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.880328    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb podName:8cefad0d-fd11-401d-aee3-8ba97afa3268 nodeName:}" failed. No retries permitted until 2026-07-28 12:29:54.380309471 +0000 UTC m=+2.990175176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nqgmb" (UniqueName: "kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb") pod "network-check-target-vhnqh" (UID: "8cefad0d-fd11-401d-aee3-8ba97afa3268") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:29:53.881721 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.881696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qmlf\" (UniqueName: \"kubernetes.io/projected/e4f78aa3-8acd-41e7-8cc4-2e33c3938634-kube-api-access-4qmlf\") pod \"node-ca-b8f4r\" (UID: \"e4f78aa3-8acd-41e7-8cc4-2e33c3938634\") " pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:53.882119 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.882098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr5k7\" (UniqueName: \"kubernetes.io/projected/16196fd0-ecdf-4771-bceb-f196876d7d8b-kube-api-access-rr5k7\") pod \"multus-additional-cni-plugins-pwj5s\" (UID: \"16196fd0-ecdf-4771-bceb-f196876d7d8b\") " pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:53.882437 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.882413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8cpd\" (UniqueName: \"kubernetes.io/projected/00ead778-8308-459e-9361-5091cc6b8849-kube-api-access-c8cpd\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:53.883973 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.883953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmt9t\" (UniqueName: \"kubernetes.io/projected/fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f-kube-api-access-fmt9t\") pod \"aws-ebs-csi-driver-node-8sngq\" (UID: \"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:53.893460 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.893434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncfs4\" (UniqueName: \"kubernetes.io/projected/c6622717-f1dd-4632-8535-16a44cceb950-kube-api-access-ncfs4\") pod \"node-resolver-wgj9h\" (UID: \"c6622717-f1dd-4632-8535-16a44cceb950\") " pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:53.901305 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.901251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal" event={"ID":"2ce9148be59f873fc772478b9a59c1fc","Type":"ContainerStarted","Data":"79ee91fbacb6de0fc273d4f1e400658b289278b44467636b7ccf08b6ef71c2a1"}
Jul 28 12:29:53.902706 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.902679    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal" event={"ID":"8955737c646d62b1a879d1f772616067","Type":"ContainerStarted","Data":"8b15a4d276566c25861e54fb378c6bff4cca7bc7538e5e031bb499549995828d"}
Jul 28 12:29:53.964199 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6eea981-39ec-4377-ab70-966c59ff1651-env-overrides\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.964199 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-sysctl-conf\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.964444 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-systemd\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.964444 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3175b78-5a24-45b8-9414-31298cd5e9ce-cni-binary-copy\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.964444 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-sysctl-conf\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.964444 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/736215d4-1e7e-422b-b6df-0ccb207e10e7-agent-certs\") pod \"konnectivity-agent-k4l99\" (UID: \"736215d4-1e7e-422b-b6df-0ccb207e10e7\") " pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-var-lib-openvswitch\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6eea981-39ec-4377-ab70-966c59ff1651-ovnkube-script-lib\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-var-lib-kubelet\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-modprobe-d\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-tuned\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-socket-dir-parent\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-kubelet\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2-iptables-alerter-script\") pod \"iptables-alerter-9vn6l\" (UID: \"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2\") " pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-var-lib-kubelet\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.964657 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-etc-kubernetes\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksx7x\" (UniqueName: \"kubernetes.io/projected/e3175b78-5a24-45b8-9414-31298cd5e9ce-kube-api-access-ksx7x\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-run-systemd\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-systemd\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-run-systemd\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-etc-openvswitch\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-sys\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3175b78-5a24-45b8-9414-31298cd5e9ce-cni-binary-copy\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-cnibin\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-daemon-config\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-run-multus-certs\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-log-socket\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.964995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6eea981-39ec-4377-ab70-966c59ff1651-ovnkube-config\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-host\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-dbus\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-cni-netd\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965113    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6eea981-39ec-4377-ab70-966c59ff1651-ovn-node-metrics-cert\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-kubernetes\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.965164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6eea981-39ec-4377-ab70-966c59ff1651-env-overrides\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-kubelet-config\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-run-netns\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-kubelet-config\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tclt\" (UniqueName: \"kubernetes.io/projected/d6eea981-39ec-4377-ab70-966c59ff1651-kube-api-access-9tclt\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-etc-openvswitch\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-system-cni-dir\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-cni-dir\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965316    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-sys\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965338    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-node-log\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-cnibin\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-socket-dir-parent\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-run\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.965798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-kubelet\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.966254 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-daemon-config\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.966254 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-run-multus-certs\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.966254 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-log-socket\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.966254 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2-iptables-alerter-script\") pod \"iptables-alerter-9vn6l\" (UID: \"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2\") " pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:53.966254 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-var-lib-kubelet\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.966254 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-etc-kubernetes\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.966540 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-run-netns\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.966540 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6eea981-39ec-4377-ab70-966c59ff1651-ovnkube-config\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.966540 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966465    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-host\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.966638 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-system-cni-dir\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.966638 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966585    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-dbus\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:53.966638 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966604    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-cni-dir\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.966638 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966627    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-cni-netd\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.966766 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966641    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-node-log\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.966766 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966688    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-kubernetes\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.966766 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.965363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-run\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.966766 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-lib-modules\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.966766 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-var-lib-cni-bin\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.967003 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-hostroot\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.967003 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-var-lib-openvswitch\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967003 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966879    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-hostroot\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.967003 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-lib-modules\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.967003 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966942    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-var-lib-cni-bin\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.967003 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.966988    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967349 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-var-lib-kubelet\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.967349 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967145    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-modprobe-d\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.967349 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-slash\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967349 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:53.967349 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/736215d4-1e7e-422b-b6df-0ccb207e10e7-konnectivity-ca\") pod \"konnectivity-agent-k4l99\" (UID: \"736215d4-1e7e-422b-b6df-0ccb207e10e7\") " pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:29:53.967349 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-run-ovn\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967349 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-sysconfig\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967350    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-run-openvswitch\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-cni-bin\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4175ed56-a41f-4b06-8a6e-e1e63390e490-tmp\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6eea981-39ec-4377-ab70-966c59ff1651-ovnkube-script-lib\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-var-lib-cni-multus\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-tuned\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-sysctl-d\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bxch\" (UniqueName: \"kubernetes.io/projected/8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2-kube-api-access-8bxch\") pod \"iptables-alerter-9vn6l\" (UID: \"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2\") " pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-run-openvswitch\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-run-k8s-cni-cncf-io\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-cni-bin\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-run-netns\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-sysconfig\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-var-lib-cni-multus\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-os-release\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-slash\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-systemd-units\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.967693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-os-release\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbhkt\" (UniqueName: \"kubernetes.io/projected/4175ed56-a41f-4b06-8a6e-e1e63390e490-kube-api-access-xbhkt\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-conf-dir\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-run-k8s-cni-cncf-io\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-multus-conf-dir\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3175b78-5a24-45b8-9414-31298cd5e9ce-host-run-netns\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2-host-slash\") pod \"iptables-alerter-9vn6l\" (UID: \"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2\") " pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2-host-slash\") pod \"iptables-alerter-9vn6l\" (UID: \"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2\") " pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-host-run-ovn-kubernetes\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4175ed56-a41f-4b06-8a6e-e1e63390e490-etc-sysctl-d\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/736215d4-1e7e-422b-b6df-0ccb207e10e7-konnectivity-ca\") pod \"konnectivity-agent-k4l99\" (UID: \"736215d4-1e7e-422b-b6df-0ccb207e10e7\") " pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-systemd-units\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.967974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6eea981-39ec-4377-ab70-966c59ff1651-run-ovn\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.968074    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:29:53.968483 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:53.968132    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret podName:7f58d468-064d-4ed1-8ff9-df98f7c7a9d5 nodeName:}" failed. No retries permitted until 2026-07-28 12:29:54.468114706 +0000 UTC m=+3.077980408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret") pod "global-pull-secret-syncer-tdmcg" (UID: "7f58d468-064d-4ed1-8ff9-df98f7c7a9d5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:29:53.969577 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.969551    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/736215d4-1e7e-422b-b6df-0ccb207e10e7-agent-certs\") pod \"konnectivity-agent-k4l99\" (UID: \"736215d4-1e7e-422b-b6df-0ccb207e10e7\") " pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:29:53.970258 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.970221    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4175ed56-a41f-4b06-8a6e-e1e63390e490-tmp\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:53.970376 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.970346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6eea981-39ec-4377-ab70-966c59ff1651-ovn-node-metrics-cert\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.975591 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.975569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksx7x\" (UniqueName: \"kubernetes.io/projected/e3175b78-5a24-45b8-9414-31298cd5e9ce-kube-api-access-ksx7x\") pod \"multus-4jc6z\" (UID: \"e3175b78-5a24-45b8-9414-31298cd5e9ce\") " pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:53.975591 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.975586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tclt\" (UniqueName: \"kubernetes.io/projected/d6eea981-39ec-4377-ab70-966c59ff1651-kube-api-access-9tclt\") pod \"ovnkube-node-kgvqt\" (UID: \"d6eea981-39ec-4377-ab70-966c59ff1651\") " pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:53.979574 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.979547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bxch\" (UniqueName: \"kubernetes.io/projected/8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2-kube-api-access-8bxch\") pod \"iptables-alerter-9vn6l\" (UID: \"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2\") " pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:53.981925 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:53.981904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbhkt\" (UniqueName: \"kubernetes.io/projected/4175ed56-a41f-4b06-8a6e-e1e63390e490-kube-api-access-xbhkt\") pod \"tuned-mvck8\" (UID: \"4175ed56-a41f-4b06-8a6e-e1e63390e490\") " pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:54.072362 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.072264    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq"
Jul 28 12:29:54.085917 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.085893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wgj9h"
Jul 28 12:29:54.100237 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.100214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9vn6l"
Jul 28 12:29:54.106139 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.106120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b8f4r"
Jul 28 12:29:54.114099 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.114075    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwj5s"
Jul 28 12:29:54.120847 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.120830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:29:54.128742 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.128714    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:29:54.136473 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.136451    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mvck8"
Jul 28 12:29:54.142354 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.142336    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4jc6z"
Jul 28 12:29:54.253366 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.253331    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:29:54.371176 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.371082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:54.371341 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:54.371260    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:29:54.371341 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:54.371335    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs podName:00ead778-8308-459e-9361-5091cc6b8849 nodeName:}" failed. No retries permitted until 2026-07-28 12:29:55.371315068 +0000 UTC m=+3.981180764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs") pod "network-metrics-daemon-l9cdv" (UID: "00ead778-8308-459e-9361-5091cc6b8849") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:29:54.472110 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.472065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:54.472110 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.472116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgmb\" (UniqueName: \"kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb\") pod \"network-check-target-vhnqh\" (UID: \"8cefad0d-fd11-401d-aee3-8ba97afa3268\") " pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:29:54.472365 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:54.472247    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:29:54.472365 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:54.472267    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:29:54.472365 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:54.472285    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:29:54.472365 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:54.472295    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nqgmb for pod openshift-network-diagnostics/network-check-target-vhnqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:29:54.472365 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:54.472320    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret podName:7f58d468-064d-4ed1-8ff9-df98f7c7a9d5 nodeName:}" failed. No retries permitted until 2026-07-28 12:29:55.472300146 +0000 UTC m=+4.082165839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret") pod "global-pull-secret-syncer-tdmcg" (UID: "7f58d468-064d-4ed1-8ff9-df98f7c7a9d5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:29:54.472365 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:54.472346    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb podName:8cefad0d-fd11-401d-aee3-8ba97afa3268 nodeName:}" failed. No retries permitted until 2026-07-28 12:29:55.472327744 +0000 UTC m=+4.082193483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqgmb" (UniqueName: "kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb") pod "network-check-target-vhnqh" (UID: "8cefad0d-fd11-401d-aee3-8ba97afa3268") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:29:54.723623 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.723597    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:29:54.820378 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.820338    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:24:54 +0000 UTC" deadline="2028-05-09 14:16:16.851071522 +0000 UTC"
Jul 28 12:29:54.820378 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.820369    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15625h46m22.03070639s"
Jul 28 12:29:54.894205 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.894174    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:54.894379 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:54.894219    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:29:54.894379 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:54.894293    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:29:54.894513 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:54.894411    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:29:54.930976 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:54.930947    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736215d4_1e7e_422b_b6df_0ccb207e10e7.slice/crio-05c1f4d49566933dc66db7be166dc83f8d11f30ec5fc2a393dbb9177e5de8564 WatchSource:0}: Error finding container 05c1f4d49566933dc66db7be166dc83f8d11f30ec5fc2a393dbb9177e5de8564: Status 404 returned error can't find the container with id 05c1f4d49566933dc66db7be166dc83f8d11f30ec5fc2a393dbb9177e5de8564
Jul 28 12:29:54.934917 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:54.934825    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3175b78_5a24_45b8_9414_31298cd5e9ce.slice/crio-06c3b61dd73a2462bb7d004c4db87f469a86d4e57ca1ea26bcfec679f2272724 WatchSource:0}: Error finding container 06c3b61dd73a2462bb7d004c4db87f469a86d4e57ca1ea26bcfec679f2272724: Status 404 returned error can't find the container with id 06c3b61dd73a2462bb7d004c4db87f469a86d4e57ca1ea26bcfec679f2272724
Jul 28 12:29:54.938534 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:54.938497    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6622717_f1dd_4632_8535_16a44cceb950.slice/crio-b071a1c730a03e1514f64ce3db5b5f6c05c1a7833fb03655b57cfbd3434f0616 WatchSource:0}: Error finding container b071a1c730a03e1514f64ce3db5b5f6c05c1a7833fb03655b57cfbd3434f0616: Status 404 returned error can't find the container with id b071a1c730a03e1514f64ce3db5b5f6c05c1a7833fb03655b57cfbd3434f0616
Jul 28 12:29:54.939191 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:54.939165    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4ad6f6_93ca_41f7_b87e_0d30ba4e8d4f.slice/crio-cdaf2435154b8d74c02a2cb7cfeaa37a12898495e1be0531fdc11029d337ba0c WatchSource:0}: Error finding container cdaf2435154b8d74c02a2cb7cfeaa37a12898495e1be0531fdc11029d337ba0c: Status 404 returned error can't find the container with id cdaf2435154b8d74c02a2cb7cfeaa37a12898495e1be0531fdc11029d337ba0c
Jul 28 12:29:54.940005 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:54.939958    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6eea981_39ec_4377_ab70_966c59ff1651.slice/crio-312d0db71d42717826533099246b8edd44a044230d88bd1a946b80d1d44c7ab1 WatchSource:0}: Error finding container 312d0db71d42717826533099246b8edd44a044230d88bd1a946b80d1d44c7ab1: Status 404 returned error can't find the container with id 312d0db71d42717826533099246b8edd44a044230d88bd1a946b80d1d44c7ab1
Jul 28 12:29:54.942067 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:54.942045    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4f78aa3_8acd_41e7_8cc4_2e33c3938634.slice/crio-50100c6bdcda06e19662c6408ef7933779a852991b37aedb09dd6a99e75e8c2b WatchSource:0}: Error finding container 50100c6bdcda06e19662c6408ef7933779a852991b37aedb09dd6a99e75e8c2b: Status 404 returned error can't find the container with id 50100c6bdcda06e19662c6408ef7933779a852991b37aedb09dd6a99e75e8c2b
Jul 28 12:29:54.965318 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:54.965295    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16196fd0_ecdf_4771_bceb_f196876d7d8b.slice/crio-9f13ecdbb56e8fe2bdf59765b6954cd7f0bbc9477b9f74c162a3b2b133e21851 WatchSource:0}: Error finding container 9f13ecdbb56e8fe2bdf59765b6954cd7f0bbc9477b9f74c162a3b2b133e21851: Status 404 returned error can't find the container with id 9f13ecdbb56e8fe2bdf59765b6954cd7f0bbc9477b9f74c162a3b2b133e21851
Jul 28 12:29:54.966305 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:54.966279    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa41c1c_4ed0_4e4d_99a7_57da3b5bd6f2.slice/crio-7eda993d50681ad3b70a307fb71e26770e841b18474546b6603623aa948dac18 WatchSource:0}: Error finding container 7eda993d50681ad3b70a307fb71e26770e841b18474546b6603623aa948dac18: Status 404 returned error can't find the container with id 7eda993d50681ad3b70a307fb71e26770e841b18474546b6603623aa948dac18
Jul 28 12:29:54.969377 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:29:54.969345    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4175ed56_a41f_4b06_8a6e_e1e63390e490.slice/crio-97ab61cde0a3b53b36f8ebd859f65e67d5ece3c52be3044c0b7c18c8f5853ff6 WatchSource:0}: Error finding container 97ab61cde0a3b53b36f8ebd859f65e67d5ece3c52be3044c0b7c18c8f5853ff6: Status 404 returned error can't find the container with id 97ab61cde0a3b53b36f8ebd859f65e67d5ece3c52be3044c0b7c18c8f5853ff6
Jul 28 12:29:55.379675 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.379524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:55.379675 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:55.379665    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:29:55.379864 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:55.379752    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs podName:00ead778-8308-459e-9361-5091cc6b8849 nodeName:}" failed. No retries permitted until 2026-07-28 12:29:57.379729351 +0000 UTC m=+5.989595081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs") pod "network-metrics-daemon-l9cdv" (UID: "00ead778-8308-459e-9361-5091cc6b8849") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:29:55.480960 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.480927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:55.480960 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.480968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgmb\" (UniqueName: \"kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb\") pod \"network-check-target-vhnqh\" (UID: \"8cefad0d-fd11-401d-aee3-8ba97afa3268\") " pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:29:55.481232 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:55.481103    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:29:55.481232 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:55.481174    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:29:55.481232 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:55.481220    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret podName:7f58d468-064d-4ed1-8ff9-df98f7c7a9d5 nodeName:}" failed. No retries permitted until 2026-07-28 12:29:57.481206536 +0000 UTC m=+6.091072238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret") pod "global-pull-secret-syncer-tdmcg" (UID: "7f58d468-064d-4ed1-8ff9-df98f7c7a9d5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:29:55.481516 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:55.481500    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:29:55.481578 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:55.481526    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nqgmb for pod openshift-network-diagnostics/network-check-target-vhnqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:29:55.481632 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:55.481591    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb podName:8cefad0d-fd11-401d-aee3-8ba97afa3268 nodeName:}" failed. No retries permitted until 2026-07-28 12:29:57.481573686 +0000 UTC m=+6.091439388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqgmb" (UniqueName: "kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb") pod "network-check-target-vhnqh" (UID: "8cefad0d-fd11-401d-aee3-8ba97afa3268") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:29:55.821151 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.821079    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:24:54 +0000 UTC" deadline="2027-12-30 00:13:50.017865845 +0000 UTC"
Jul 28 12:29:55.821151 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.821148    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12467h43m54.196722176s"
Jul 28 12:29:55.905215 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.904544    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:55.905215 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:55.904694    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:29:55.918116 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.918023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal" event={"ID":"2ce9148be59f873fc772478b9a59c1fc","Type":"ContainerStarted","Data":"c742d5427de1eb2666f102c80069239a1259cd9912a8e68ef581b0edb7b34672"}
Jul 28 12:29:55.934854 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.934814    2565 generic.go:356] "Generic (PLEG): container finished" podID="8955737c646d62b1a879d1f772616067" containerID="86738200c692a864299646a1899dd000fcff461d3f8186baafec30f4ff01abd6" exitCode=0
Jul 28 12:29:55.935045 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.934923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal" event={"ID":"8955737c646d62b1a879d1f772616067","Type":"ContainerDied","Data":"86738200c692a864299646a1899dd000fcff461d3f8186baafec30f4ff01abd6"}
Jul 28 12:29:55.936086 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.935783    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-176.ec2.internal" podStartSLOduration=2.935762385 podStartE2EDuration="2.935762385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:29:55.934754666 +0000 UTC m=+4.544620377" watchObservedRunningTime="2026-07-28 12:29:55.935762385 +0000 UTC m=+4.545628098"
Jul 28 12:29:55.941651 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.941618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwj5s" event={"ID":"16196fd0-ecdf-4771-bceb-f196876d7d8b","Type":"ContainerStarted","Data":"9f13ecdbb56e8fe2bdf59765b6954cd7f0bbc9477b9f74c162a3b2b133e21851"}
Jul 28 12:29:55.946113 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.946086    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt" event={"ID":"d6eea981-39ec-4377-ab70-966c59ff1651","Type":"ContainerStarted","Data":"312d0db71d42717826533099246b8edd44a044230d88bd1a946b80d1d44c7ab1"}
Jul 28 12:29:55.947704 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.947675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq" event={"ID":"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f","Type":"ContainerStarted","Data":"cdaf2435154b8d74c02a2cb7cfeaa37a12898495e1be0531fdc11029d337ba0c"}
Jul 28 12:29:55.960757 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.960724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wgj9h" event={"ID":"c6622717-f1dd-4632-8535-16a44cceb950","Type":"ContainerStarted","Data":"b071a1c730a03e1514f64ce3db5b5f6c05c1a7833fb03655b57cfbd3434f0616"}
Jul 28 12:29:55.968346 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.968308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4jc6z" event={"ID":"e3175b78-5a24-45b8-9414-31298cd5e9ce","Type":"ContainerStarted","Data":"06c3b61dd73a2462bb7d004c4db87f469a86d4e57ca1ea26bcfec679f2272724"}
Jul 28 12:29:55.975857 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.975824    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k4l99" event={"ID":"736215d4-1e7e-422b-b6df-0ccb207e10e7","Type":"ContainerStarted","Data":"05c1f4d49566933dc66db7be166dc83f8d11f30ec5fc2a393dbb9177e5de8564"}
Jul 28 12:29:55.991301 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:55.991265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mvck8" event={"ID":"4175ed56-a41f-4b06-8a6e-e1e63390e490","Type":"ContainerStarted","Data":"97ab61cde0a3b53b36f8ebd859f65e67d5ece3c52be3044c0b7c18c8f5853ff6"}
Jul 28 12:29:56.005270 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:56.005222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9vn6l" event={"ID":"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2","Type":"ContainerStarted","Data":"7eda993d50681ad3b70a307fb71e26770e841b18474546b6603623aa948dac18"}
Jul 28 12:29:56.014399 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:56.014361    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b8f4r" event={"ID":"e4f78aa3-8acd-41e7-8cc4-2e33c3938634","Type":"ContainerStarted","Data":"50100c6bdcda06e19662c6408ef7933779a852991b37aedb09dd6a99e75e8c2b"}
Jul 28 12:29:56.894350 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:56.894319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:29:56.894814 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:56.894440    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:29:56.894897 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:56.894837    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:56.894958 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:56.894937    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:29:57.030208 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:57.030171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal" event={"ID":"8955737c646d62b1a879d1f772616067","Type":"ContainerStarted","Data":"c033be144fb86e6d11220e4efd500dffeb2644513ed922533944ef85bdef1389"}
Jul 28 12:29:57.047356 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:57.047297    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-176.ec2.internal" podStartSLOduration=4.047273808 podStartE2EDuration="4.047273808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:29:57.046517643 +0000 UTC m=+5.656383355" watchObservedRunningTime="2026-07-28 12:29:57.047273808 +0000 UTC m=+5.657139520"
Jul 28 12:29:57.405940 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:57.405667    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:57.405940 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:57.405860    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:29:57.405940 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:57.405932    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs podName:00ead778-8308-459e-9361-5091cc6b8849 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:01.405910923 +0000 UTC m=+10.015776638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs") pod "network-metrics-daemon-l9cdv" (UID: "00ead778-8308-459e-9361-5091cc6b8849") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:29:57.506372 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:57.506332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:57.506548 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:57.506390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgmb\" (UniqueName: \"kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb\") pod \"network-check-target-vhnqh\" (UID: \"8cefad0d-fd11-401d-aee3-8ba97afa3268\") " pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:29:57.506628 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:57.506573    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:29:57.506628 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:57.506592    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:29:57.506628 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:57.506606    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nqgmb for pod openshift-network-diagnostics/network-check-target-vhnqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:29:57.506784 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:57.506665    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb podName:8cefad0d-fd11-401d-aee3-8ba97afa3268 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:01.506646663 +0000 UTC m=+10.116512368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqgmb" (UniqueName: "kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb") pod "network-check-target-vhnqh" (UID: "8cefad0d-fd11-401d-aee3-8ba97afa3268") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:29:57.507142 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:57.507118    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:29:57.507229 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:57.507190    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret podName:7f58d468-064d-4ed1-8ff9-df98f7c7a9d5 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:01.507170069 +0000 UTC m=+10.117035774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret") pod "global-pull-secret-syncer-tdmcg" (UID: "7f58d468-064d-4ed1-8ff9-df98f7c7a9d5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:29:57.895281 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:57.895247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:57.895769 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:57.895402    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:29:58.894165 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:58.894122    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:29:58.894352 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:58.894122    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:29:58.894352 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:58.894255    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:29:58.894352 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:58.894295    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:29:59.894553 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:29:59.894150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:29:59.894553 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:29:59.894271    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:00.895188 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:00.894453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:00.895188 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:00.894585    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:00.895188 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:00.894964    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:00.895188 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:00.895078    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:01.439210 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:01.439176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:01.439388 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:01.439309    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:30:01.439388 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:01.439363    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs podName:00ead778-8308-459e-9361-5091cc6b8849 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:09.439350839 +0000 UTC m=+18.049216524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs") pod "network-metrics-daemon-l9cdv" (UID: "00ead778-8308-459e-9361-5091cc6b8849") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:30:01.539691 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:01.539659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:01.539855 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:01.539708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgmb\" (UniqueName: \"kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb\") pod \"network-check-target-vhnqh\" (UID: \"8cefad0d-fd11-401d-aee3-8ba97afa3268\") " pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:01.539855 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:01.539813    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:30:01.539855 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:01.539830    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:30:01.539855 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:01.539848    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:30:01.540120 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:01.539860    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nqgmb for pod openshift-network-diagnostics/network-check-target-vhnqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:30:01.540120 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:01.539928    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb podName:8cefad0d-fd11-401d-aee3-8ba97afa3268 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:09.53989169 +0000 UTC m=+18.149757379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqgmb" (UniqueName: "kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb") pod "network-check-target-vhnqh" (UID: "8cefad0d-fd11-401d-aee3-8ba97afa3268") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:30:01.540120 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:01.539956    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret podName:7f58d468-064d-4ed1-8ff9-df98f7c7a9d5 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:09.539946881 +0000 UTC m=+18.149812581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret") pod "global-pull-secret-syncer-tdmcg" (UID: "7f58d468-064d-4ed1-8ff9-df98f7c7a9d5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:30:01.894854 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:01.894821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:01.895035 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:01.894933    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:02.894518 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:02.893916    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:02.894518 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:02.894056    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:02.894518 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:02.894401    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:02.894518 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:02.894477    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:03.896343 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:03.896304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:03.896784 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:03.896419    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:04.894407 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:04.894376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:04.894583 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:04.894492    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:04.894583 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:04.894552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:04.894692 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:04.894655    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:05.894312 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:05.894282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:05.894770 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:05.894409    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:06.893575 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:06.893545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:06.893741 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:06.893545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:06.893741 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:06.893661    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:06.893741 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:06.893720    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:07.894164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:07.894129    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:07.894556 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:07.894244    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:08.893430 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:08.893394    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:08.893711 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:08.893436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:08.893711 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:08.893509    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:08.893711 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:08.893652    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:09.498365 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:09.498324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:09.498790 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:09.498451    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:30:09.498790 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:09.498525    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs podName:00ead778-8308-459e-9361-5091cc6b8849 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:25.498507285 +0000 UTC m=+34.108372982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs") pod "network-metrics-daemon-l9cdv" (UID: "00ead778-8308-459e-9361-5091cc6b8849") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:30:09.598969 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:09.598937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:09.598969 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:09.598973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgmb\" (UniqueName: \"kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb\") pod \"network-check-target-vhnqh\" (UID: \"8cefad0d-fd11-401d-aee3-8ba97afa3268\") " pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:09.599182 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:09.599082    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:30:09.599182 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:09.599091    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:30:09.599182 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:09.599110    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:30:09.599182 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:09.599119    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nqgmb for pod openshift-network-diagnostics/network-check-target-vhnqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:30:09.599182 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:09.599150    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret podName:7f58d468-064d-4ed1-8ff9-df98f7c7a9d5 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:25.599132642 +0000 UTC m=+34.208998330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret") pod "global-pull-secret-syncer-tdmcg" (UID: "7f58d468-064d-4ed1-8ff9-df98f7c7a9d5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:30:09.599182 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:09.599167    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb podName:8cefad0d-fd11-401d-aee3-8ba97afa3268 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:25.599158823 +0000 UTC m=+34.209024509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqgmb" (UniqueName: "kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb") pod "network-check-target-vhnqh" (UID: "8cefad0d-fd11-401d-aee3-8ba97afa3268") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:30:09.893508 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:09.893481    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:09.893675 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:09.893605    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:10.894417 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:10.894388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:10.894875 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:10.894490    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:10.894875 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:10.894556    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:10.894875 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:10.894643    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:11.894166 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:11.894133    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:11.894345 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:11.894264    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:12.893925 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:12.893891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:12.894400 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:12.893891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:12.894400 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:12.894023    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:12.894400 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:12.894083    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:13.895335 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:13.894969    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:13.895904 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:13.895455    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:14.066646 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.066615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wgj9h" event={"ID":"c6622717-f1dd-4632-8535-16a44cceb950","Type":"ContainerStarted","Data":"aa87e1b3e7e89fcfea547a5b0957746b66a322eaa12a42303900b114faea98bf"}
Jul 28 12:30:14.068059 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.068034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4jc6z" event={"ID":"e3175b78-5a24-45b8-9414-31298cd5e9ce","Type":"ContainerStarted","Data":"e39ddc0b4020196bcd800a7366941e5f46edb719164f65087654574040dd147b"}
Jul 28 12:30:14.069324 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.069305    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k4l99" event={"ID":"736215d4-1e7e-422b-b6df-0ccb207e10e7","Type":"ContainerStarted","Data":"082f9f314329bb7b65d27b762b6bb5e5900094697968eb9f1f16509a39816d4c"}
Jul 28 12:30:14.070669 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.070649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mvck8" event={"ID":"4175ed56-a41f-4b06-8a6e-e1e63390e490","Type":"ContainerStarted","Data":"d9bd0ca3f3109b1932c2140988a8c841017bf54001593b7be98f1d7575214943"}
Jul 28 12:30:14.071973 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.071954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b8f4r" event={"ID":"e4f78aa3-8acd-41e7-8cc4-2e33c3938634","Type":"ContainerStarted","Data":"371c66a54b81fc36fa3bb81c488272092cc6d398c08926b63709eb7b81a5fa20"}
Jul 28 12:30:14.073226 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.073205    2565 generic.go:356] "Generic (PLEG): container finished" podID="16196fd0-ecdf-4771-bceb-f196876d7d8b" containerID="58f1115683b3ec7e1f202c90aefa5de7ee5af9f4fe6f05c8dedc260c081e202d" exitCode=0
Jul 28 12:30:14.073315 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.073272    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwj5s" event={"ID":"16196fd0-ecdf-4771-bceb-f196876d7d8b","Type":"ContainerDied","Data":"58f1115683b3ec7e1f202c90aefa5de7ee5af9f4fe6f05c8dedc260c081e202d"}
Jul 28 12:30:14.077776 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.077760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt" event={"ID":"d6eea981-39ec-4377-ab70-966c59ff1651","Type":"ContainerStarted","Data":"34d344a17b404aa486050e76df267cebbe62eb95d1929e6d919b4867d85207bc"}
Jul 28 12:30:14.077831 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.077822    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt" event={"ID":"d6eea981-39ec-4377-ab70-966c59ff1651","Type":"ContainerStarted","Data":"748ee05bece3160f91ebcf826fdb2196c4b00a9017f869b55fb98baac76e74c8"}
Jul 28 12:30:14.077884 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.077862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt" event={"ID":"d6eea981-39ec-4377-ab70-966c59ff1651","Type":"ContainerStarted","Data":"b2da2ca7629eac60a35eddf0db15ae6f29b14f861b903679cf8f68ca46888106"}
Jul 28 12:30:14.077941 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.077901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt" event={"ID":"d6eea981-39ec-4377-ab70-966c59ff1651","Type":"ContainerStarted","Data":"03ab40f1a297b8e7782570bda2f0e7d051d99550da70774f1500bf0818f36965"}
Jul 28 12:30:14.077941 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.077928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt" event={"ID":"d6eea981-39ec-4377-ab70-966c59ff1651","Type":"ContainerStarted","Data":"cd2f29ecf644286ab985b2c992f4fed54dcb3485a268cd8b95b05ad3de28c51e"}
Jul 28 12:30:14.079191 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.079174    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq" event={"ID":"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f","Type":"ContainerStarted","Data":"b6900f68084d8b8c608484ce1a5f4cf253d175b85049368c3720dcc3d1e05240"}
Jul 28 12:30:14.082501 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.082458    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wgj9h" podStartSLOduration=3.573505624 podStartE2EDuration="22.082441149s" totalImagesPullingTime="18.508935525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:14.081915566 +0000 UTC m=+22.691781272" watchObservedRunningTime="2026-07-28 12:30:14.082441149 +0000 UTC m=+22.692306858"
Jul 28 12:30:14.109263 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.109228    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b8f4r" podStartSLOduration=7.289773673 podStartE2EDuration="22.109216477s" totalImagesPullingTime="14.819442804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:14.109091954 +0000 UTC m=+22.718957662" watchObservedRunningTime="2026-07-28 12:30:14.109216477 +0000 UTC m=+22.719082182"
Jul 28 12:30:14.109513 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.109494    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4jc6z" podStartSLOduration=3.482955193 podStartE2EDuration="22.109489488s" totalImagesPullingTime="18.626534295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:14.097274936 +0000 UTC m=+22.707140643" watchObservedRunningTime="2026-07-28 12:30:14.109489488 +0000 UTC m=+22.719355219"
Jul 28 12:30:14.123731 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.123696    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k4l99" podStartSLOduration=3.644592514 podStartE2EDuration="22.123684494s" totalImagesPullingTime="18.47909198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:14.123238178 +0000 UTC m=+22.733103889" watchObservedRunningTime="2026-07-28 12:30:14.123684494 +0000 UTC m=+22.733550199"
Jul 28 12:30:14.174832 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.174746    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mvck8" podStartSLOduration=3.695151912 podStartE2EDuration="22.174730612s" totalImagesPullingTime="18.4795787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:14.173880802 +0000 UTC m=+22.783746509" watchObservedRunningTime="2026-07-28 12:30:14.174730612 +0000 UTC m=+22.784596310"
Jul 28 12:30:14.205636 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.205604    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:30:14.206136 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.206118    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:30:14.894250 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.894230    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:14.894371 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.894232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:14.894411 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:14.894393    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:14.894493 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:14.894315    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:14.994132 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:14.994090    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 12:30:15.083736 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:15.083466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9vn6l" event={"ID":"8aa41c1c-4ed0-4e4d-99a7-57da3b5bd6f2","Type":"ContainerStarted","Data":"af46725a9a32726a5b5ba344d074bcbbab8c517ef4cb9eb0384244d16fb40822"}
Jul 28 12:30:15.087887 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:15.087861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt" event={"ID":"d6eea981-39ec-4377-ab70-966c59ff1651","Type":"ContainerStarted","Data":"cad3e071bd2623a92bd21a553f07f937b61e8def058eb901182a02c8c7d5cc90"}
Jul 28 12:30:15.089901 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:15.089878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq" event={"ID":"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f","Type":"ContainerStarted","Data":"8a2e66bf8914021d572fbc968b44b2a3d27060791258298e0196079933e50d3a"}
Jul 28 12:30:15.090046 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:15.090029    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:30:15.090649 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:15.090634    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k4l99"
Jul 28 12:30:15.099229 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:15.099186    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9vn6l" podStartSLOduration=8.284182743 podStartE2EDuration="23.099174067s" totalImagesPullingTime="14.814991324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:15.098545166 +0000 UTC m=+23.708410887" watchObservedRunningTime="2026-07-28 12:30:15.099174067 +0000 UTC m=+23.709039774"
Jul 28 12:30:15.823123 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:15.823001    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T12:30:14.994107532Z","UUID":"05602c6f-8428-458e-8e6d-1fa5618fa968","Handler":null,"Name":"","Endpoint":""}
Jul 28 12:30:15.824740 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:15.824719    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 12:30:15.824880 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:15.824761    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 12:30:15.893933 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:15.893870    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:15.894165 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:15.894075    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:16.894038 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:16.894010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:16.894038 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:16.894017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:16.894522 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:16.894116    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:16.894522 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:16.894192    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:17.097787 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:17.097752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt" event={"ID":"d6eea981-39ec-4377-ab70-966c59ff1651","Type":"ContainerStarted","Data":"a2b5e435306066d358f28fa45d0b226547b8014c7b2989e31370a79e1e952645"}
Jul 28 12:30:17.100168 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:17.100126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq" event={"ID":"fa4ad6f6-93ca-41f7-b87e-0d30ba4e8d4f","Type":"ContainerStarted","Data":"979b53ba0e33832d627dd6a8ebf4c460b28ca019076565fbde9f6d92e1547aa4"}
Jul 28 12:30:17.119514 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:17.119466    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8sngq" podStartSLOduration=4.310416916 podStartE2EDuration="25.119451833s" totalImagesPullingTime="20.809034917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:17.119444892 +0000 UTC m=+25.729310599" watchObservedRunningTime="2026-07-28 12:30:17.119451833 +0000 UTC m=+25.729317539"
Jul 28 12:30:17.897240 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:17.894548    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:17.897240 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:17.894766    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:18.894590 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:18.894429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:18.894685 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:18.894457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:18.894685 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:18.894670    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:18.894777 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:18.894757    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:19.106179 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:19.106148    2565 generic.go:356] "Generic (PLEG): container finished" podID="16196fd0-ecdf-4771-bceb-f196876d7d8b" containerID="a6c5f16e3b131733ce8147978761973d25a520e8011a2232bb6697e62d840fcd" exitCode=0
Jul 28 12:30:19.106945 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:19.106223    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwj5s" event={"ID":"16196fd0-ecdf-4771-bceb-f196876d7d8b","Type":"ContainerDied","Data":"a6c5f16e3b131733ce8147978761973d25a520e8011a2232bb6697e62d840fcd"}
Jul 28 12:30:19.109773 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:19.109743    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt" event={"ID":"d6eea981-39ec-4377-ab70-966c59ff1651","Type":"ContainerStarted","Data":"69ce1dce2039024da8f35a09d1dd95a7e3d99c752416d750e16fe3bdd9ad1705"}
Jul 28 12:30:19.109957 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:19.109942    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:30:19.125577 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:19.125558    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:30:19.153773 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:19.153708    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt" podStartSLOduration=8.628966085 podStartE2EDuration="27.153695414s" totalImagesPullingTime="18.524729329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:19.152695197 +0000 UTC m=+27.762560903" watchObservedRunningTime="2026-07-28 12:30:19.153695414 +0000 UTC m=+27.763561121"
Jul 28 12:30:19.893943 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:19.893746    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:19.894168 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:19.894063    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:20.112400 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:20.112368    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:30:20.113065 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:20.112458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:30:20.127829 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:20.127801    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:30:20.720631 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:20.720597    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tdmcg"]
Jul 28 12:30:20.720811 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:20.720742    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:20.720881 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:20.720831    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:20.724312 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:20.724287    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l9cdv"]
Jul 28 12:30:20.724436 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:20.724352    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vhnqh"]
Jul 28 12:30:20.724436 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:20.724427    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:20.724556 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:20.724519    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:20.724556 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:20.724552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:20.724656 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:20.724639    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:21.116662 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:21.116575    2565 generic.go:356] "Generic (PLEG): container finished" podID="16196fd0-ecdf-4771-bceb-f196876d7d8b" containerID="10ea0f5c5e1903cedf11062eb67e83bb3449359918b52f864ed3855f7cd79ba3" exitCode=0
Jul 28 12:30:21.116662 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:21.116652    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwj5s" event={"ID":"16196fd0-ecdf-4771-bceb-f196876d7d8b","Type":"ContainerDied","Data":"10ea0f5c5e1903cedf11062eb67e83bb3449359918b52f864ed3855f7cd79ba3"}
Jul 28 12:30:21.894424 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:21.894394    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:21.894589 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:21.894551    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:22.893621 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:22.893592    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:22.894064 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:22.893732    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:22.894064 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:22.893768    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:22.894064 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:22.893841    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:23.123814 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:23.123736    2565 generic.go:356] "Generic (PLEG): container finished" podID="16196fd0-ecdf-4771-bceb-f196876d7d8b" containerID="72e17e5e8501573cdc7b3af8c5fae1b193d1eccbc35677b7c78a0f81abe7213f" exitCode=0
Jul 28 12:30:23.123814 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:23.123779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwj5s" event={"ID":"16196fd0-ecdf-4771-bceb-f196876d7d8b","Type":"ContainerDied","Data":"72e17e5e8501573cdc7b3af8c5fae1b193d1eccbc35677b7c78a0f81abe7213f"}
Jul 28 12:30:23.893455 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:23.893430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:23.893606 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:23.893539    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:24.893958 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:24.893920    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:24.894408 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:24.894059    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhnqh" podUID="8cefad0d-fd11-401d-aee3-8ba97afa3268"
Jul 28 12:30:24.894408 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:24.894121    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:24.894408 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:24.894242    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tdmcg" podUID="7f58d468-064d-4ed1-8ff9-df98f7c7a9d5"
Jul 28 12:30:25.521395 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:25.521362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:25.521591 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:25.521526    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:30:25.521591 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:25.521588    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs podName:00ead778-8308-459e-9361-5091cc6b8849 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:57.521573568 +0000 UTC m=+66.131439253 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs") pod "network-metrics-daemon-l9cdv" (UID: "00ead778-8308-459e-9361-5091cc6b8849") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:30:25.622748 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:25.622721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:25.622748 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:25.622754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgmb\" (UniqueName: \"kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb\") pod \"network-check-target-vhnqh\" (UID: \"8cefad0d-fd11-401d-aee3-8ba97afa3268\") " pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:25.622997 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:25.622882    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:30:25.622997 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:25.622951    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret podName:7f58d468-064d-4ed1-8ff9-df98f7c7a9d5 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:57.622931512 +0000 UTC m=+66.232797216 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret") pod "global-pull-secret-syncer-tdmcg" (UID: "7f58d468-064d-4ed1-8ff9-df98f7c7a9d5") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:30:25.623158 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:25.622882    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:30:25.623272 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:25.623172    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:30:25.623272 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:25.623188    2565 projected.go:196] Error preparing data for projected volume kube-api-access-nqgmb for pod openshift-network-diagnostics/network-check-target-vhnqh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:30:25.623272 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:25.623247    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb podName:8cefad0d-fd11-401d-aee3-8ba97afa3268 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:57.623229203 +0000 UTC m=+66.233094907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nqgmb" (UniqueName: "kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb") pod "network-check-target-vhnqh" (UID: "8cefad0d-fd11-401d-aee3-8ba97afa3268") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:30:25.894831 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:25.894358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:25.894831 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:25.894486    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:30:26.217315 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.217286    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-176.ec2.internal" event="NodeReady"
Jul 28 12:30:26.217511 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.217452    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 12:30:26.264434 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.264399    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"]
Jul 28 12:30:26.266918 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.266897    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:26.270375 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.269005    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b6hh6\""
Jul 28 12:30:26.270375 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.269299    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 12:30:26.270375 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.269507    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 12:30:26.270375 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.269584    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"]
Jul 28 12:30:26.271224 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.271207    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.273735 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.273717    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nfll9\""
Jul 28 12:30:26.274760 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.274086    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 12:30:26.274760 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.274576    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 12:30:26.274760 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.274582    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 12:30:26.279701 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.279681    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 12:30:26.284188 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.282941    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"]
Jul 28 12:30:26.290304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.290285    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"]
Jul 28 12:30:26.294684 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.294269    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w9z87"]
Jul 28 12:30:26.296158 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.296142    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zlfr9"]
Jul 28 12:30:26.296291 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.296274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.298000 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.297969    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlfr9"
Jul 28 12:30:26.305524 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.305504    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 12:30:26.305655 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.305637    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bstgx\""
Jul 28 12:30:26.306027 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.306002    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 12:30:26.306116 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.306046    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 12:30:26.306174 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.306123    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-74b58\""
Jul 28 12:30:26.306174 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.306124    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 12:30:26.306273 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.306235    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 12:30:26.321105 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.321079    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlfr9"]
Jul 28 12:30:26.321223 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.321125    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w9z87"]
Jul 28 12:30:26.429301 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429270    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-trusted-ca\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.429301 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksjnk\" (UniqueName: \"kubernetes.io/projected/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-kube-api-access-ksjnk\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.429520 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fksq7\" (UniqueName: \"kubernetes.io/projected/4fbdc23a-ddae-4e43-a918-6386d294be86-kube-api-access-fksq7\") pod \"ingress-canary-zlfr9\" (UID: \"4fbdc23a-ddae-4e43-a918-6386d294be86\") " pod="openshift-ingress-canary/ingress-canary-zlfr9"
Jul 28 12:30:26.429520 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.429520 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429469    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-certificates\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.429520 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-config-volume\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.429684 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.429684 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fbdc23a-ddae-4e43-a918-6386d294be86-cert\") pod \"ingress-canary-zlfr9\" (UID: \"4fbdc23a-ddae-4e43-a918-6386d294be86\") " pod="openshift-ingress-canary/ingress-canary-zlfr9"
Jul 28 12:30:26.429684 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-installation-pull-secrets\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.429684 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-tmp-dir\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.429684 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-image-registry-private-configuration\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.429882 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0b2325f-97cb-47d9-b60e-501fe53c3fab-ca-trust-extracted\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.429882 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:26.429882 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr88g\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-kube-api-access-lr88g\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.429882 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-bound-sa-token\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.429882 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.429862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9da533a3-e5e5-424a-bc79-7746d876a327-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:26.494489 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.494410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:26.530264 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.530237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksjnk\" (UniqueName: \"kubernetes.io/projected/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-kube-api-access-ksjnk\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.530264 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.530266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fksq7\" (UniqueName: \"kubernetes.io/projected/4fbdc23a-ddae-4e43-a918-6386d294be86-kube-api-access-fksq7\") pod \"ingress-canary-zlfr9\" (UID: \"4fbdc23a-ddae-4e43-a918-6386d294be86\") " pod="openshift-ingress-canary/ingress-canary-zlfr9"
Jul 28 12:30:26.530474 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.530420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.530474 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.530465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-certificates\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.530565 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.530491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-config-volume\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.530565 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.530508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.530565 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.530524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fbdc23a-ddae-4e43-a918-6386d294be86-cert\") pod \"ingress-canary-zlfr9\" (UID: \"4fbdc23a-ddae-4e43-a918-6386d294be86\") " pod="openshift-ingress-canary/ingress-canary-zlfr9"
Jul 28 12:30:26.530565 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:26.530527    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:30:26.530565 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:26.530545    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d6c6f45-gw7fr: secret "image-registry-tls" not found
Jul 28 12:30:26.530565 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.530549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-installation-pull-secrets\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.530799 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.530568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-tmp-dir\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.530799 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:26.530600    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls podName:f0b2325f-97cb-47d9-b60e-501fe53c3fab nodeName:}" failed. No retries permitted until 2026-07-28 12:30:27.030579458 +0000 UTC m=+35.640445151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls") pod "image-registry-7c9d6c6f45-gw7fr" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab") : secret "image-registry-tls" not found
Jul 28 12:30:26.530799 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:26.530635    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:30:26.530799 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.530632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-image-registry-private-configuration\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.531428 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.531403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-certificates\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.532147 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.531951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-tmp-dir\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.533388 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:26.530687    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls podName:6bd4e8d2-1e75-4009-8aad-b916a0bb6266 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:27.03067127 +0000 UTC m=+35.640536969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls") pod "dns-default-w9z87" (UID: "6bd4e8d2-1e75-4009-8aad-b916a0bb6266") : secret "dns-default-metrics-tls" not found
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.533831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-config-volume\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.533909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0b2325f-97cb-47d9-b60e-501fe53c3fab-ca-trust-extracted\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.533943    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.534006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr88g\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-kube-api-access-lr88g\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.534047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-bound-sa-token\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.534080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9da533a3-e5e5-424a-bc79-7746d876a327-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.534148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-trusted-ca\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.534278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0b2325f-97cb-47d9-b60e-501fe53c3fab-ca-trust-extracted\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:26.534599    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:26.534654    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert podName:9da533a3-e5e5-424a-bc79-7746d876a327 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:27.034639304 +0000 UTC m=+35.644505022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6bldm" (UID: "9da533a3-e5e5-424a-bc79-7746d876a327") : secret "networking-console-plugin-cert" not found
Jul 28 12:30:26.535112 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.535062    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-trusted-ca\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.539148 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.536345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-image-registry-private-configuration\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.539148 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.536424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fbdc23a-ddae-4e43-a918-6386d294be86-cert\") pod \"ingress-canary-zlfr9\" (UID: \"4fbdc23a-ddae-4e43-a918-6386d294be86\") " pod="openshift-ingress-canary/ingress-canary-zlfr9"
Jul 28 12:30:26.539148 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.538337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9da533a3-e5e5-424a-bc79-7746d876a327-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:26.539367 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.539348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksjnk\" (UniqueName: \"kubernetes.io/projected/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-kube-api-access-ksjnk\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:26.540970 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.540950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fksq7\" (UniqueName: \"kubernetes.io/projected/4fbdc23a-ddae-4e43-a918-6386d294be86-kube-api-access-fksq7\") pod \"ingress-canary-zlfr9\" (UID: \"4fbdc23a-ddae-4e43-a918-6386d294be86\") " pod="openshift-ingress-canary/ingress-canary-zlfr9"
Jul 28 12:30:26.544512 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.544489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-installation-pull-secrets\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.544851 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.544745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-bound-sa-token\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.545223 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.545207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr88g\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-kube-api-access-lr88g\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:26.604784 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.604740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:26.611622 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.611591    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlfr9"
Jul 28 12:30:26.893973 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.893885    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:26.894154 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.893998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:26.896485 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.896213    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 12:30:26.896485 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.896227    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 12:30:26.896485 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.896219    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 12:30:26.896485 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:26.896219    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-klsqn\""
Jul 28 12:30:27.039354 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:27.039311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:27.039354 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:27.039353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:27.039586 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:27.039379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:27.039586 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:27.039475    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:30:27.039586 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:27.039486    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:30:27.039586 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:27.039476    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:30:27.039586 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:27.039541    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert podName:9da533a3-e5e5-424a-bc79-7746d876a327 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:28.039527425 +0000 UTC m=+36.649393114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6bldm" (UID: "9da533a3-e5e5-424a-bc79-7746d876a327") : secret "networking-console-plugin-cert" not found
Jul 28 12:30:27.039586 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:27.039547    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d6c6f45-gw7fr: secret "image-registry-tls" not found
Jul 28 12:30:27.039586 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:27.039559    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls podName:6bd4e8d2-1e75-4009-8aad-b916a0bb6266 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:28.039548474 +0000 UTC m=+36.649414162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls") pod "dns-default-w9z87" (UID: "6bd4e8d2-1e75-4009-8aad-b916a0bb6266") : secret "dns-default-metrics-tls" not found
Jul 28 12:30:27.039586 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:27.039589    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls podName:f0b2325f-97cb-47d9-b60e-501fe53c3fab nodeName:}" failed. No retries permitted until 2026-07-28 12:30:28.039571626 +0000 UTC m=+36.649437322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls") pod "image-registry-7c9d6c6f45-gw7fr" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab") : secret "image-registry-tls" not found
Jul 28 12:30:27.325874 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:27.325843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlfr9"]
Jul 28 12:30:27.330350 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:30:27.330267    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbdc23a_ddae_4e43_a918_6386d294be86.slice/crio-30420a523dcbeb7f71d4448c1eaa11c260a9e8a4503eaa859a0596cf2bb81eeb WatchSource:0}: Error finding container 30420a523dcbeb7f71d4448c1eaa11c260a9e8a4503eaa859a0596cf2bb81eeb: Status 404 returned error can't find the container with id 30420a523dcbeb7f71d4448c1eaa11c260a9e8a4503eaa859a0596cf2bb81eeb
Jul 28 12:30:27.894172 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:27.894141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:27.896183 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:27.896161    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 12:30:27.896317 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:27.896191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nm4t9\""
Jul 28 12:30:28.047344 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:28.047316    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:28.048037 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:28.047351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:28.048037 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:28.047375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:28.048037 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:28.047426    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:30:28.048037 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:28.047444    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d6c6f45-gw7fr: secret "image-registry-tls" not found
Jul 28 12:30:28.048037 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:28.047483    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:30:28.048037 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:28.047491    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls podName:f0b2325f-97cb-47d9-b60e-501fe53c3fab nodeName:}" failed. No retries permitted until 2026-07-28 12:30:30.047477807 +0000 UTC m=+38.657343493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls") pod "image-registry-7c9d6c6f45-gw7fr" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab") : secret "image-registry-tls" not found
Jul 28 12:30:28.048037 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:28.047503    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:30:28.048037 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:28.047526    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert podName:9da533a3-e5e5-424a-bc79-7746d876a327 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:30.047515588 +0000 UTC m=+38.657381277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6bldm" (UID: "9da533a3-e5e5-424a-bc79-7746d876a327") : secret "networking-console-plugin-cert" not found
Jul 28 12:30:28.048037 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:28.047548    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls podName:6bd4e8d2-1e75-4009-8aad-b916a0bb6266 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:30.04753098 +0000 UTC m=+38.657396666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls") pod "dns-default-w9z87" (UID: "6bd4e8d2-1e75-4009-8aad-b916a0bb6266") : secret "dns-default-metrics-tls" not found
Jul 28 12:30:28.137865 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:28.137837    2565 generic.go:356] "Generic (PLEG): container finished" podID="16196fd0-ecdf-4771-bceb-f196876d7d8b" containerID="b35e148f1218bc2507a9cce841fed247076d05794962564456b4f7b06144636e" exitCode=0
Jul 28 12:30:28.138034 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:28.137917    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwj5s" event={"ID":"16196fd0-ecdf-4771-bceb-f196876d7d8b","Type":"ContainerDied","Data":"b35e148f1218bc2507a9cce841fed247076d05794962564456b4f7b06144636e"}
Jul 28 12:30:28.139252 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:28.139230    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlfr9" event={"ID":"4fbdc23a-ddae-4e43-a918-6386d294be86","Type":"ContainerStarted","Data":"30420a523dcbeb7f71d4448c1eaa11c260a9e8a4503eaa859a0596cf2bb81eeb"}
Jul 28 12:30:29.145462 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:29.145165    2565 generic.go:356] "Generic (PLEG): container finished" podID="16196fd0-ecdf-4771-bceb-f196876d7d8b" containerID="864aaf5197542e7580b7736ba83a46af739f624a7c280d6c2c664ddfb8a10884" exitCode=0
Jul 28 12:30:29.145462 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:29.145240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwj5s" event={"ID":"16196fd0-ecdf-4771-bceb-f196876d7d8b","Type":"ContainerDied","Data":"864aaf5197542e7580b7736ba83a46af739f624a7c280d6c2c664ddfb8a10884"}
Jul 28 12:30:30.067844 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:30.067795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:30.068092 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:30.067860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:30.068092 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:30.067906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:30.068092 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:30.067971    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:30:30.068092 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:30.068002    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:30:30.068092 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:30.068008    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d6c6f45-gw7fr: secret "image-registry-tls" not found
Jul 28 12:30:30.068092 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:30.068039    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:30:30.068092 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:30.068075    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls podName:6bd4e8d2-1e75-4009-8aad-b916a0bb6266 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:34.068054913 +0000 UTC m=+42.677920613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls") pod "dns-default-w9z87" (UID: "6bd4e8d2-1e75-4009-8aad-b916a0bb6266") : secret "dns-default-metrics-tls" not found
Jul 28 12:30:30.068092 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:30.068097    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert podName:9da533a3-e5e5-424a-bc79-7746d876a327 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:34.068083098 +0000 UTC m=+42.677948792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6bldm" (UID: "9da533a3-e5e5-424a-bc79-7746d876a327") : secret "networking-console-plugin-cert" not found
Jul 28 12:30:30.068443 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:30.068117    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls podName:f0b2325f-97cb-47d9-b60e-501fe53c3fab nodeName:}" failed. No retries permitted until 2026-07-28 12:30:34.068107382 +0000 UTC m=+42.677973069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls") pod "image-registry-7c9d6c6f45-gw7fr" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab") : secret "image-registry-tls" not found
Jul 28 12:30:30.152051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:30.152012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwj5s" event={"ID":"16196fd0-ecdf-4771-bceb-f196876d7d8b","Type":"ContainerStarted","Data":"d8f5d0f2fea2a29677b12557b415a5c434e13a077211c08f67bee8ebedc603fc"}
Jul 28 12:30:30.173124 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:30.173067    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pwj5s" podStartSLOduration=8.430689716 podStartE2EDuration="38.173052935s" totalImagesPullingTime="29.742363219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:30.171962979 +0000 UTC m=+38.781828689" watchObservedRunningTime="2026-07-28 12:30:30.173052935 +0000 UTC m=+38.782918642"
Jul 28 12:30:30.294285 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:30.294254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:30.394308 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:30.394263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:30.896582 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:30.896546    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:30.969442 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:30.969410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:31.031891 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:31.031863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:31.093969 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:31.093937    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:31.155514 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:31.155435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlfr9" event={"ID":"4fbdc23a-ddae-4e43-a918-6386d294be86","Type":"ContainerStarted","Data":"ce5e64e5c7ecd877189e5703ad67135700e20a1b80717d0d91d00ae980e2296e"}
Jul 28 12:30:31.172048 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:31.172000    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zlfr9" podStartSLOduration=2.24211069 podStartE2EDuration="5.171965321s" totalImagesPullingTime="2.929854631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:30:31.171683791 +0000 UTC m=+39.781549519" watchObservedRunningTime="2026-07-28 12:30:31.171965321 +0000 UTC m=+39.781831006"
Jul 28 12:30:31.964814 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:31.964777    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:32.065058 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:32.065025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:34.097150 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:34.097102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:34.097150 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:34.097147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:34.097599 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:34.097169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:34.097599 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:34.097249    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:30:34.097599 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:34.097252    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:30:34.097599 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:34.097294    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert podName:9da533a3-e5e5-424a-bc79-7746d876a327 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:42.097281038 +0000 UTC m=+50.707146723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6bldm" (UID: "9da533a3-e5e5-424a-bc79-7746d876a327") : secret "networking-console-plugin-cert" not found
Jul 28 12:30:34.097599 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:34.097254    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:30:34.097599 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:34.097306    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls podName:6bd4e8d2-1e75-4009-8aad-b916a0bb6266 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:42.097300779 +0000 UTC m=+50.707166464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls") pod "dns-default-w9z87" (UID: "6bd4e8d2-1e75-4009-8aad-b916a0bb6266") : secret "dns-default-metrics-tls" not found
Jul 28 12:30:34.097599 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:34.097308    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d6c6f45-gw7fr: secret "image-registry-tls" not found
Jul 28 12:30:34.097599 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:34.097340    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls podName:f0b2325f-97cb-47d9-b60e-501fe53c3fab nodeName:}" failed. No retries permitted until 2026-07-28 12:30:42.09732639 +0000 UTC m=+50.707192076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls") pod "image-registry-7c9d6c6f45-gw7fr" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab") : secret "image-registry-tls" not found
Jul 28 12:30:36.113761 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:36.113722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:37.632039 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:37.632005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:37.731568 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:37.731542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:37.832387 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:37.832354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:38.271626 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:38.271590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:38.372677 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:38.372651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:39.655430 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:39.655394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:39.754562 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:39.754526    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:42.156191 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:42.156155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:42.156677 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:42.156301    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:42.156677 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:42.156341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:42.156677 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:42.156307    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:30:42.156677 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:42.156496    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:30:42.156677 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:42.156500    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert podName:9da533a3-e5e5-424a-bc79-7746d876a327 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:58.156481158 +0000 UTC m=+66.766346856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6bldm" (UID: "9da533a3-e5e5-424a-bc79-7746d876a327") : secret "networking-console-plugin-cert" not found
Jul 28 12:30:42.156677 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:42.156570    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls podName:6bd4e8d2-1e75-4009-8aad-b916a0bb6266 nodeName:}" failed. No retries permitted until 2026-07-28 12:30:58.156554454 +0000 UTC m=+66.766420139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls") pod "dns-default-w9z87" (UID: "6bd4e8d2-1e75-4009-8aad-b916a0bb6266") : secret "dns-default-metrics-tls" not found
Jul 28 12:30:42.156677 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:42.156365    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:30:42.156677 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:42.156587    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d6c6f45-gw7fr: secret "image-registry-tls" not found
Jul 28 12:30:42.156677 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:42.156625    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls podName:f0b2325f-97cb-47d9-b60e-501fe53c3fab nodeName:}" failed. No retries permitted until 2026-07-28 12:30:58.15661516 +0000 UTC m=+66.766480845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls") pod "image-registry-7c9d6c6f45-gw7fr" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab") : secret "image-registry-tls" not found
Jul 28 12:30:42.652433 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:42.652390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:43.100282 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:43.100245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:43.160661 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:43.160628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:46.011873 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:46.011837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:46.068690 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:46.068662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:46.250576 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:46.250538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:48.490991 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:48.490938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:50.256268 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:50.256229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:50.310167 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:50.310120    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:52.133887 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:52.133861    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kgvqt"
Jul 28 12:30:52.288458 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:52.288420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:52.350000 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:52.349963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:54.735481 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:54.735450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:54.796639 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:54.796605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:54.853491 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:54.853454    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:30:57.570990 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.570939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:30:57.573598 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.573578    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 12:30:57.581310 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:57.581279    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 12:30:57.581394 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:57.581374    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs podName:00ead778-8308-459e-9361-5091cc6b8849 nodeName:}" failed. No retries permitted until 2026-07-28 12:32:01.581352017 +0000 UTC m=+130.191217705 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs") pod "network-metrics-daemon-l9cdv" (UID: "00ead778-8308-459e-9361-5091cc6b8849") : secret "metrics-daemon-secret" not found
Jul 28 12:30:57.672199 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.672163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:57.672199 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.672204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgmb\" (UniqueName: \"kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb\") pod \"network-check-target-vhnqh\" (UID: \"8cefad0d-fd11-401d-aee3-8ba97afa3268\") " pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:57.674476 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.674459    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 12:30:57.674576 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.674555    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 12:30:57.684968 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.684944    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 12:30:57.686839 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.686819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f58d468-064d-4ed1-8ff9-df98f7c7a9d5-original-pull-secret\") pod \"global-pull-secret-syncer-tdmcg\" (UID: \"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5\") " pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:57.696333 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.696303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqgmb\" (UniqueName: \"kubernetes.io/projected/8cefad0d-fd11-401d-aee3-8ba97afa3268-kube-api-access-nqgmb\") pod \"network-check-target-vhnqh\" (UID: \"8cefad0d-fd11-401d-aee3-8ba97afa3268\") " pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:57.806838 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.806805    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-klsqn\""
Jul 28 12:30:57.810540 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.810520    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tdmcg"
Jul 28 12:30:57.815184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.815165    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:30:57.940474 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.940444    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tdmcg"]
Jul 28 12:30:57.944232 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:30:57.944204    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f58d468_064d_4ed1_8ff9_df98f7c7a9d5.slice/crio-e51651dc0027fcd3a4a3d91a8eb7fcf9533bf6b5c628708c07e3d700fb522f52 WatchSource:0}: Error finding container e51651dc0027fcd3a4a3d91a8eb7fcf9533bf6b5c628708c07e3d700fb522f52: Status 404 returned error can't find the container with id e51651dc0027fcd3a4a3d91a8eb7fcf9533bf6b5c628708c07e3d700fb522f52
Jul 28 12:30:57.956743 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:57.956718    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vhnqh"]
Jul 28 12:30:57.959959 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:30:57.959936    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cefad0d_fd11_401d_aee3_8ba97afa3268.slice/crio-01e13e009b53c765c278dc3f207128208538e3ddee38adafe9258c6fa0a1abd8 WatchSource:0}: Error finding container 01e13e009b53c765c278dc3f207128208538e3ddee38adafe9258c6fa0a1abd8: Status 404 returned error can't find the container with id 01e13e009b53c765c278dc3f207128208538e3ddee38adafe9258c6fa0a1abd8
Jul 28 12:30:58.175868 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:58.175789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:30:58.175868 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:58.175826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:30:58.175868 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:58.175847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:30:58.176110 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:58.175936    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:30:58.176110 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:58.175942    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:30:58.176110 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:58.175953    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d6c6f45-gw7fr: secret "image-registry-tls" not found
Jul 28 12:30:58.176110 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:58.175949    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:30:58.176110 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:58.176039    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert podName:9da533a3-e5e5-424a-bc79-7746d876a327 nodeName:}" failed. No retries permitted until 2026-07-28 12:31:30.176025863 +0000 UTC m=+98.785891548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6bldm" (UID: "9da533a3-e5e5-424a-bc79-7746d876a327") : secret "networking-console-plugin-cert" not found
Jul 28 12:30:58.176110 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:58.176054    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls podName:f0b2325f-97cb-47d9-b60e-501fe53c3fab nodeName:}" failed. No retries permitted until 2026-07-28 12:31:30.176048383 +0000 UTC m=+98.785914082 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls") pod "image-registry-7c9d6c6f45-gw7fr" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab") : secret "image-registry-tls" not found
Jul 28 12:30:58.176110 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:30:58.176064    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls podName:6bd4e8d2-1e75-4009-8aad-b916a0bb6266 nodeName:}" failed. No retries permitted until 2026-07-28 12:31:30.176059097 +0000 UTC m=+98.785924796 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls") pod "dns-default-w9z87" (UID: "6bd4e8d2-1e75-4009-8aad-b916a0bb6266") : secret "dns-default-metrics-tls" not found
Jul 28 12:30:58.219365 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:58.219330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tdmcg" event={"ID":"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5","Type":"ContainerStarted","Data":"e51651dc0027fcd3a4a3d91a8eb7fcf9533bf6b5c628708c07e3d700fb522f52"}
Jul 28 12:30:58.220333 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:30:58.220315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vhnqh" event={"ID":"8cefad0d-fd11-401d-aee3-8ba97afa3268","Type":"ContainerStarted","Data":"01e13e009b53c765c278dc3f207128208538e3ddee38adafe9258c6fa0a1abd8"}
Jul 28 12:31:03.236659 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:03.236625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vhnqh" event={"ID":"8cefad0d-fd11-401d-aee3-8ba97afa3268","Type":"ContainerStarted","Data":"6fcbb3cff6af23cfdb624679cb68a4b3ed7c99664e3ee6eaf10ce14d7022b7b2"}
Jul 28 12:31:03.237125 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:03.236759    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:31:03.238133 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:03.238111    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tdmcg" event={"ID":"7f58d468-064d-4ed1-8ff9-df98f7c7a9d5","Type":"ContainerStarted","Data":"3fbad4509925b0092940fac422e7293f5dfaa390f23b6624f61508953475cd14"}
Jul 28 12:31:03.251583 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:03.251541    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vhnqh" podStartSLOduration=66.664474665 podStartE2EDuration="1m11.25152369s" totalImagesPullingTime="4.587049025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:31:03.250732104 +0000 UTC m=+71.860597813" watchObservedRunningTime="2026-07-28 12:31:03.25152369 +0000 UTC m=+71.861389401"
Jul 28 12:31:03.263888 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:03.263843    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tdmcg" podStartSLOduration=66.656336978 podStartE2EDuration="1m11.263830272s" totalImagesPullingTime="4.607493294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:31:03.26345276 +0000 UTC m=+71.873318478" watchObservedRunningTime="2026-07-28 12:31:03.263830272 +0000 UTC m=+71.873695979"
Jul 28 12:31:08.991852 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:08.991810    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:31:09.044029 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:09.043971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:31:15.673442 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:15.673305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:31:15.745377 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:15.745340    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:31:30.212864 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:30.212821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:31:30.212864 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:30.212870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:31:30.213524 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:30.212893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:31:30.213524 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:31:30.212997    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:31:30.213524 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:31:30.212973    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:31:30.213524 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:31:30.213008    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:31:30.213524 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:31:30.213059    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert podName:9da533a3-e5e5-424a-bc79-7746d876a327 nodeName:}" failed. No retries permitted until 2026-07-28 12:32:34.213045418 +0000 UTC m=+162.822911104 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6bldm" (UID: "9da533a3-e5e5-424a-bc79-7746d876a327") : secret "networking-console-plugin-cert" not found
Jul 28 12:31:30.213524 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:31:30.213089    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls podName:6bd4e8d2-1e75-4009-8aad-b916a0bb6266 nodeName:}" failed. No retries permitted until 2026-07-28 12:32:34.213069515 +0000 UTC m=+162.822935216 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls") pod "dns-default-w9z87" (UID: "6bd4e8d2-1e75-4009-8aad-b916a0bb6266") : secret "dns-default-metrics-tls" not found
Jul 28 12:31:30.213524 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:31:30.213017    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d6c6f45-gw7fr: secret "image-registry-tls" not found
Jul 28 12:31:30.213524 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:31:30.213148    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls podName:f0b2325f-97cb-47d9-b60e-501fe53c3fab nodeName:}" failed. No retries permitted until 2026-07-28 12:32:34.213136715 +0000 UTC m=+162.823002403 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls") pod "image-registry-7c9d6c6f45-gw7fr" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab") : secret "image-registry-tls" not found
Jul 28 12:31:34.243129 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:31:34.243096    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vhnqh"
Jul 28 12:32:01.638435 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:32:01.638395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:32:01.638931 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:01.638549    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 12:32:01.638931 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:01.638615    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs podName:00ead778-8308-459e-9361-5091cc6b8849 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:03.638598828 +0000 UTC m=+252.248464515 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs") pod "network-metrics-daemon-l9cdv" (UID: "00ead778-8308-459e-9361-5091cc6b8849") : secret "metrics-daemon-secret" not found
Jul 28 12:32:29.280530 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:29.280482    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm" podUID="9da533a3-e5e5-424a-bc79-7746d876a327"
Jul 28 12:32:29.287619 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:29.287595    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr" podUID="f0b2325f-97cb-47d9-b60e-501fe53c3fab"
Jul 28 12:32:29.306737 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:29.306703    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w9z87" podUID="6bd4e8d2-1e75-4009-8aad-b916a0bb6266"
Jul 28 12:32:29.444461 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:32:29.444433    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:32:29.444461 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:32:29.444462    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9z87"
Jul 28 12:32:29.444649 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:32:29.444567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:32:30.903225 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:30.903187    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:32:34.263892 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:32:34.263854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:32:34.263892 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:32:34.263894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:32:34.264504 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:32:34.263918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:32:34.264504 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:34.264014    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:32:34.264504 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:34.264031    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c9d6c6f45-gw7fr: secret "image-registry-tls" not found
Jul 28 12:32:34.264504 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:34.264040    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 12:32:34.264504 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:34.264051    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:32:34.264504 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:34.264093    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls podName:f0b2325f-97cb-47d9-b60e-501fe53c3fab nodeName:}" failed. No retries permitted until 2026-07-28 12:34:36.264078627 +0000 UTC m=+284.873944352 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls") pod "image-registry-7c9d6c6f45-gw7fr" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab") : secret "image-registry-tls" not found
Jul 28 12:32:34.264504 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:34.264106    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert podName:9da533a3-e5e5-424a-bc79-7746d876a327 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:36.264100571 +0000 UTC m=+284.873966257 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-6bldm" (UID: "9da533a3-e5e5-424a-bc79-7746d876a327") : secret "networking-console-plugin-cert" not found
Jul 28 12:32:34.264504 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:32:34.264116    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls podName:6bd4e8d2-1e75-4009-8aad-b916a0bb6266 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:36.264111277 +0000 UTC m=+284.873976963 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls") pod "dns-default-w9z87" (UID: "6bd4e8d2-1e75-4009-8aad-b916a0bb6266") : secret "dns-default-metrics-tls" not found
Jul 28 12:32:41.894411 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:32:41.894382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:33:46.400178 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:33:46.400147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:03.695589 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:03.695553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:34:03.695971 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:03.695699    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 12:34:03.695971 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:03.695769    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs podName:00ead778-8308-459e-9361-5091cc6b8849 nodeName:}" failed. No retries permitted until 2026-07-28 12:36:05.695753582 +0000 UTC m=+374.305619267 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs") pod "network-metrics-daemon-l9cdv" (UID: "00ead778-8308-459e-9361-5091cc6b8849") : secret "metrics-daemon-secret" not found
Jul 28 12:34:12.381489 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.381454    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"]
Jul 28 12:34:12.383322 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.383306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:12.386903 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.386844    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 28 12:34:12.386903 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.386890    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 28 12:34:12.387132 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.386915    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:34:12.387335 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.387315    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qjx4p\""
Jul 28 12:34:12.387737 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.387723    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn"]
Jul 28 12:34:12.389319 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.389300    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"]
Jul 28 12:34:12.389466 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.389444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn"
Jul 28 12:34:12.391045 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.391028    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b5489f54f-lfkkv"]
Jul 28 12:34:12.391135 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.391123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.392829 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.392810    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v"]
Jul 28 12:34:12.392994 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.392903    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.392994 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.392923    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 12:34:12.393400 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.393377    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-q68lb\""
Jul 28 12:34:12.393495 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.393386    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 12:34:12.393495 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.393437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 12:34:12.393610 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.393514    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bl757\""
Jul 28 12:34:12.393610 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.393582    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:34:12.394725 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.394707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v"
Jul 28 12:34:12.395052 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.395035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 12:34:12.395128 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.395112    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 12:34:12.395175 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.395140    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 12:34:12.395313 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.395300    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 12:34:12.397256 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.397233    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 12:34:12.397729 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.397713    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bv4gj\""
Jul 28 12:34:12.398302 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.398284    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"]
Jul 28 12:34:12.398401 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.398388    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 12:34:12.398453 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.398426    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 12:34:12.399710 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.399691    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:34:12.399801 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.399729    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pczpl\""
Jul 28 12:34:12.403951 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.403931    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"]
Jul 28 12:34:12.405269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.405251    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn"]
Jul 28 12:34:12.412319 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.412298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b5489f54f-lfkkv"]
Jul 28 12:34:12.426777 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.426744    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v"]
Jul 28 12:34:12.480517 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.480486    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-8d6cg"]
Jul 28 12:34:12.482438 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.482424    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-2vpn2"]
Jul 28 12:34:12.482554 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.482539    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.484153 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.484135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.484454 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.484435    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 28 12:34:12.484932 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.484919    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-s6z2h\""
Jul 28 12:34:12.485257 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.485241    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 28 12:34:12.485683 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.485670    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:34:12.485955 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.485944    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 28 12:34:12.487636 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.487608    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 12:34:12.487737 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.487664    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 12:34:12.487737 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.487672    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 28 12:34:12.488571 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.488557    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 28 12:34:12.489249 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.489237    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lxhzt\""
Jul 28 12:34:12.499196 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.499176    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-8d6cg"]
Jul 28 12:34:12.500081 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.500064    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-2vpn2"]
Jul 28 12:34:12.501618 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.501600    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 28 12:34:12.502839 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.502811    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 28 12:34:12.561658 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.561629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbk5l\" (UniqueName: \"kubernetes.io/projected/fbb8f4a1-6686-49ee-9e82-88cf65d64996-kube-api-access-kbk5l\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.561658 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.561663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13271b45-4738-4235-bb1e-ddf00d89730b-config\") pod \"service-ca-operator-5d6c75f84f-xtv6q\" (UID: \"13271b45-4738-4235-bb1e-ddf00d89730b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.561895 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.561682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr79c\" (UniqueName: \"kubernetes.io/projected/ae267fd0-533b-4767-b974-5f174a5cfcbb-kube-api-access-rr79c\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:12.561895 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.561776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.561895 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.561808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g248s\" (UniqueName: \"kubernetes.io/projected/11f54447-3aec-46ac-b202-0573d743113e-kube-api-access-g248s\") pod \"network-check-source-7d88cb55d8-lsccn\" (UID: \"11f54447-3aec-46ac-b202-0573d743113e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn"
Jul 28 12:34:12.561895 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.561839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6xkm\" (UniqueName: \"kubernetes.io/projected/13271b45-4738-4235-bb1e-ddf00d89730b-kube-api-access-k6xkm\") pod \"service-ca-operator-5d6c75f84f-xtv6q\" (UID: \"13271b45-4738-4235-bb1e-ddf00d89730b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.561895 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.561868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bdm9\" (UniqueName: \"kubernetes.io/projected/a96582bc-6f32-4b60-a9d4-eeb3f5bedac2-kube-api-access-8bdm9\") pod \"volume-data-source-validator-549c6d54cf-58s4v\" (UID: \"a96582bc-6f32-4b60-a9d4-eeb3f5bedac2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v"
Jul 28 12:34:12.562177 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.561924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.562177 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.561963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:12.562177 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.562022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13271b45-4738-4235-bb1e-ddf00d89730b-serving-cert\") pod \"service-ca-operator-5d6c75f84f-xtv6q\" (UID: \"13271b45-4738-4235-bb1e-ddf00d89730b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.562177 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.562069    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-stats-auth\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.562177 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.562117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-default-certificate\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.662583 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.662583 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g248s\" (UniqueName: \"kubernetes.io/projected/11f54447-3aec-46ac-b202-0573d743113e-kube-api-access-g248s\") pod \"network-check-source-7d88cb55d8-lsccn\" (UID: \"11f54447-3aec-46ac-b202-0573d743113e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn"
Jul 28 12:34:12.662583 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce291cde-2d3b-4c5f-8246-814881b8c891-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.662849 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6xkm\" (UniqueName: \"kubernetes.io/projected/13271b45-4738-4235-bb1e-ddf00d89730b-kube-api-access-k6xkm\") pod \"service-ca-operator-5d6c75f84f-xtv6q\" (UID: \"13271b45-4738-4235-bb1e-ddf00d89730b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.662849 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:12.662677    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:34:12.662849 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bdm9\" (UniqueName: \"kubernetes.io/projected/a96582bc-6f32-4b60-a9d4-eeb3f5bedac2-kube-api-access-8bdm9\") pod \"volume-data-source-validator-549c6d54cf-58s4v\" (UID: \"a96582bc-6f32-4b60-a9d4-eeb3f5bedac2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v"
Jul 28 12:34:12.662849 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:12.662739    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:13.162719164 +0000 UTC m=+261.772584850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : secret "router-metrics-certs-default" not found
Jul 28 12:34:12.662849 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce291cde-2d3b-4c5f-8246-814881b8c891-service-ca-bundle\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.662849 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.662849 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:12.662849 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13271b45-4738-4235-bb1e-ddf00d89730b-serving-cert\") pod \"service-ca-operator-5d6c75f84f-xtv6q\" (UID: \"13271b45-4738-4235-bb1e-ddf00d89730b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-stats-auth\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:12.662915    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:13.162897875 +0000 UTC m=+261.772763580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : configmap references non-existent config key: service-ca.crt
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:12.662925    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.662943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzcqm\" (UniqueName: \"kubernetes.io/projected/3e07272f-da7a-4f83-8feb-3721e38d02f6-kube-api-access-jzcqm\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:12.662963    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls podName:ae267fd0-533b-4767-b974-5f174a5cfcbb nodeName:}" failed. No retries permitted until 2026-07-28 12:34:13.162951183 +0000 UTC m=+261.772816870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls") pod "cluster-samples-operator-6748489656-wchjd" (UID: "ae267fd0-533b-4767-b974-5f174a5cfcbb") : secret "samples-operator-tls" not found
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce291cde-2d3b-4c5f-8246-814881b8c891-snapshots\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-default-certificate\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce291cde-2d3b-4c5f-8246-814881b8c891-tmp\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663077    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g2qm\" (UniqueName: \"kubernetes.io/projected/ce291cde-2d3b-4c5f-8246-814881b8c891-kube-api-access-6g2qm\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e07272f-da7a-4f83-8feb-3721e38d02f6-config\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e07272f-da7a-4f83-8feb-3721e38d02f6-trusted-ca\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.663292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbk5l\" (UniqueName: \"kubernetes.io/projected/fbb8f4a1-6686-49ee-9e82-88cf65d64996-kube-api-access-kbk5l\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.663938 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e07272f-da7a-4f83-8feb-3721e38d02f6-serving-cert\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.663938 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce291cde-2d3b-4c5f-8246-814881b8c891-serving-cert\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.663938 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13271b45-4738-4235-bb1e-ddf00d89730b-config\") pod \"service-ca-operator-5d6c75f84f-xtv6q\" (UID: \"13271b45-4738-4235-bb1e-ddf00d89730b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.663938 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.663528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr79c\" (UniqueName: \"kubernetes.io/projected/ae267fd0-533b-4767-b974-5f174a5cfcbb-kube-api-access-rr79c\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:12.664171 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.664152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13271b45-4738-4235-bb1e-ddf00d89730b-config\") pod \"service-ca-operator-5d6c75f84f-xtv6q\" (UID: \"13271b45-4738-4235-bb1e-ddf00d89730b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.665337 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.665310    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13271b45-4738-4235-bb1e-ddf00d89730b-serving-cert\") pod \"service-ca-operator-5d6c75f84f-xtv6q\" (UID: \"13271b45-4738-4235-bb1e-ddf00d89730b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.665503 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.665488    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-default-certificate\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.665546 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.665529    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-stats-auth\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.667537 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.667516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:12.671495 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.671465    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bdm9\" (UniqueName: \"kubernetes.io/projected/a96582bc-6f32-4b60-a9d4-eeb3f5bedac2-kube-api-access-8bdm9\") pod \"volume-data-source-validator-549c6d54cf-58s4v\" (UID: \"a96582bc-6f32-4b60-a9d4-eeb3f5bedac2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v"
Jul 28 12:34:12.671591 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.671525    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr79c\" (UniqueName: \"kubernetes.io/projected/ae267fd0-533b-4767-b974-5f174a5cfcbb-kube-api-access-rr79c\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:12.671917 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.671882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6xkm\" (UniqueName: \"kubernetes.io/projected/13271b45-4738-4235-bb1e-ddf00d89730b-kube-api-access-k6xkm\") pod \"service-ca-operator-5d6c75f84f-xtv6q\" (UID: \"13271b45-4738-4235-bb1e-ddf00d89730b\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.672078 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.672011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbk5l\" (UniqueName: \"kubernetes.io/projected/fbb8f4a1-6686-49ee-9e82-88cf65d64996-kube-api-access-kbk5l\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:12.672182 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.672163    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g248s\" (UniqueName: \"kubernetes.io/projected/11f54447-3aec-46ac-b202-0573d743113e-kube-api-access-g248s\") pod \"network-check-source-7d88cb55d8-lsccn\" (UID: \"11f54447-3aec-46ac-b202-0573d743113e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn"
Jul 28 12:34:12.702152 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.702136    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn"
Jul 28 12:34:12.709569 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.709548    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"
Jul 28 12:34:12.721515 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.721497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v"
Jul 28 12:34:12.765080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.764282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce291cde-2d3b-4c5f-8246-814881b8c891-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.765080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.764337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce291cde-2d3b-4c5f-8246-814881b8c891-service-ca-bundle\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.765080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.764435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzcqm\" (UniqueName: \"kubernetes.io/projected/3e07272f-da7a-4f83-8feb-3721e38d02f6-kube-api-access-jzcqm\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.765080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.764465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce291cde-2d3b-4c5f-8246-814881b8c891-snapshots\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.765080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.764493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce291cde-2d3b-4c5f-8246-814881b8c891-tmp\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.765080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.764517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g2qm\" (UniqueName: \"kubernetes.io/projected/ce291cde-2d3b-4c5f-8246-814881b8c891-kube-api-access-6g2qm\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.765080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.764542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e07272f-da7a-4f83-8feb-3721e38d02f6-config\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.765080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.764569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e07272f-da7a-4f83-8feb-3721e38d02f6-trusted-ca\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.765080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.764613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e07272f-da7a-4f83-8feb-3721e38d02f6-serving-cert\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.765080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.764644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce291cde-2d3b-4c5f-8246-814881b8c891-serving-cert\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.768341 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.765792    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce291cde-2d3b-4c5f-8246-814881b8c891-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.768341 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.766334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce291cde-2d3b-4c5f-8246-814881b8c891-tmp\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.768341 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.766796    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce291cde-2d3b-4c5f-8246-814881b8c891-service-ca-bundle\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.768341 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.767751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce291cde-2d3b-4c5f-8246-814881b8c891-snapshots\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.768341 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.767776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3e07272f-da7a-4f83-8feb-3721e38d02f6-config\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.768667 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.768454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce291cde-2d3b-4c5f-8246-814881b8c891-serving-cert\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.768890 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.768706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3e07272f-da7a-4f83-8feb-3721e38d02f6-trusted-ca\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.770678 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.770581    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:12.771154 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.771113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3e07272f-da7a-4f83-8feb-3721e38d02f6-serving-cert\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.778787 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.778166    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzcqm\" (UniqueName: \"kubernetes.io/projected/3e07272f-da7a-4f83-8feb-3721e38d02f6-kube-api-access-jzcqm\") pod \"console-operator-584dcb6b54-8d6cg\" (UID: \"3e07272f-da7a-4f83-8feb-3721e38d02f6\") " pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.778787 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.778363    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g2qm\" (UniqueName: \"kubernetes.io/projected/ce291cde-2d3b-4c5f-8246-814881b8c891-kube-api-access-6g2qm\") pod \"insights-operator-5885fdb759-2vpn2\" (UID: \"ce291cde-2d3b-4c5f-8246-814881b8c891\") " pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.793196 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.793174    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:12.799468 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.799416    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-2vpn2"
Jul 28 12:34:12.845527 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.845495    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn"]
Jul 28 12:34:12.851965 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:12.851927    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f54447_3aec_46ac_b202_0573d743113e.slice/crio-b9bfc0d42e7fde132602f68bab204888ca343f82718a50a3f0ea16ca87b8f3e7 WatchSource:0}: Error finding container b9bfc0d42e7fde132602f68bab204888ca343f82718a50a3f0ea16ca87b8f3e7: Status 404 returned error can't find the container with id b9bfc0d42e7fde132602f68bab204888ca343f82718a50a3f0ea16ca87b8f3e7
Jul 28 12:34:12.878829 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.878745    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q"]
Jul 28 12:34:12.887353 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:12.887172    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13271b45_4738_4235_bb1e_ddf00d89730b.slice/crio-8a0d69b4edf822f40d4142f3d515cc9bf1f0f84ef89a91d891d9e6debc4c81f3 WatchSource:0}: Error finding container 8a0d69b4edf822f40d4142f3d515cc9bf1f0f84ef89a91d891d9e6debc4c81f3: Status 404 returned error can't find the container with id 8a0d69b4edf822f40d4142f3d515cc9bf1f0f84ef89a91d891d9e6debc4c81f3
Jul 28 12:34:12.889035 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.889012    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v"]
Jul 28 12:34:12.892092 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:12.892069    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96582bc_6f32_4b60_a9d4_eeb3f5bedac2.slice/crio-1ed5094bb4d179c118ba1a040ebff0c69df23e6a84e4eca8e097d3d606fb9671 WatchSource:0}: Error finding container 1ed5094bb4d179c118ba1a040ebff0c69df23e6a84e4eca8e097d3d606fb9671: Status 404 returned error can't find the container with id 1ed5094bb4d179c118ba1a040ebff0c69df23e6a84e4eca8e097d3d606fb9671
Jul 28 12:34:12.960502 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.960474    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-2vpn2"]
Jul 28 12:34:12.964007 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:12.963943    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce291cde_2d3b_4c5f_8246_814881b8c891.slice/crio-b0220755e3694e9909259c0b44f7f22c338eb9e1cbdf4a08af037ab647e5b06e WatchSource:0}: Error finding container b0220755e3694e9909259c0b44f7f22c338eb9e1cbdf4a08af037ab647e5b06e: Status 404 returned error can't find the container with id b0220755e3694e9909259c0b44f7f22c338eb9e1cbdf4a08af037ab647e5b06e
Jul 28 12:34:12.977067 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:12.977044    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-8d6cg"]
Jul 28 12:34:12.980145 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:12.980106    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e07272f_da7a_4f83_8feb_3721e38d02f6.slice/crio-487f3e5894e5b0e13545ebf72e6b8fc5893384cf8ca55b857f2addad7a2b67b1 WatchSource:0}: Error finding container 487f3e5894e5b0e13545ebf72e6b8fc5893384cf8ca55b857f2addad7a2b67b1: Status 404 returned error can't find the container with id 487f3e5894e5b0e13545ebf72e6b8fc5893384cf8ca55b857f2addad7a2b67b1
Jul 28 12:34:13.166969 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:13.166893    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:13.167137 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:13.166997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:13.167137 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:13.167023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:13.167137 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:13.167073    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:34:13.167137 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:13.167131    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:14.167115151 +0000 UTC m=+262.776980839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : configmap references non-existent config key: service-ca.crt
Jul 28 12:34:13.167304 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:13.167142    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:34:13.167304 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:13.167146    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls podName:ae267fd0-533b-4767-b974-5f174a5cfcbb nodeName:}" failed. No retries permitted until 2026-07-28 12:34:14.167139931 +0000 UTC m=+262.777005619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls") pod "cluster-samples-operator-6748489656-wchjd" (UID: "ae267fd0-533b-4767-b974-5f174a5cfcbb") : secret "samples-operator-tls" not found
Jul 28 12:34:13.167304 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:13.167196    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:14.167177964 +0000 UTC m=+262.777043650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : secret "router-metrics-certs-default" not found
Jul 28 12:34:13.695618 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:13.695533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q" event={"ID":"13271b45-4738-4235-bb1e-ddf00d89730b","Type":"ContainerStarted","Data":"8a0d69b4edf822f40d4142f3d515cc9bf1f0f84ef89a91d891d9e6debc4c81f3"}
Jul 28 12:34:13.698234 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:13.698202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-2vpn2" event={"ID":"ce291cde-2d3b-4c5f-8246-814881b8c891","Type":"ContainerStarted","Data":"b0220755e3694e9909259c0b44f7f22c338eb9e1cbdf4a08af037ab647e5b06e"}
Jul 28 12:34:13.700274 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:13.700246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg" event={"ID":"3e07272f-da7a-4f83-8feb-3721e38d02f6","Type":"ContainerStarted","Data":"487f3e5894e5b0e13545ebf72e6b8fc5893384cf8ca55b857f2addad7a2b67b1"}
Jul 28 12:34:13.702653 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:13.702629    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn" event={"ID":"11f54447-3aec-46ac-b202-0573d743113e","Type":"ContainerStarted","Data":"3cddf75f6f2f14697db34bd9c8106894f4e82a118d0c55b1033d7fcda5532f2b"}
Jul 28 12:34:13.702767 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:13.702672    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn" event={"ID":"11f54447-3aec-46ac-b202-0573d743113e","Type":"ContainerStarted","Data":"b9bfc0d42e7fde132602f68bab204888ca343f82718a50a3f0ea16ca87b8f3e7"}
Jul 28 12:34:13.705378 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:13.705346    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v" event={"ID":"a96582bc-6f32-4b60-a9d4-eeb3f5bedac2","Type":"ContainerStarted","Data":"1ed5094bb4d179c118ba1a040ebff0c69df23e6a84e4eca8e097d3d606fb9671"}
Jul 28 12:34:14.176472 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:14.176398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:14.176472 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:14.176450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:14.176652 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:14.176490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:14.176652 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:14.176562    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:34:14.176652 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:14.176625    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:16.176605581 +0000 UTC m=+264.786471274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : secret "router-metrics-certs-default" not found
Jul 28 12:34:14.176652 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:14.176650    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:34:14.176935 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:14.176651    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:16.176632907 +0000 UTC m=+264.786498610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : configmap references non-existent config key: service-ca.crt
Jul 28 12:34:14.176935 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:14.176728    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls podName:ae267fd0-533b-4767-b974-5f174a5cfcbb nodeName:}" failed. No retries permitted until 2026-07-28 12:34:16.176714043 +0000 UTC m=+264.786579738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls") pod "cluster-samples-operator-6748489656-wchjd" (UID: "ae267fd0-533b-4767-b974-5f174a5cfcbb") : secret "samples-operator-tls" not found
Jul 28 12:34:14.711022 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:14.710933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v" event={"ID":"a96582bc-6f32-4b60-a9d4-eeb3f5bedac2","Type":"ContainerStarted","Data":"e1e0bc594edad67ca44544fcf3eb6ea8302efb1c950a77534f9ce5acc37edec9"}
Jul 28 12:34:14.726084 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:14.725901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-lsccn" podStartSLOduration=2.725882198 podStartE2EDuration="2.725882198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:13.717611687 +0000 UTC m=+262.327477396" watchObservedRunningTime="2026-07-28 12:34:14.725882198 +0000 UTC m=+263.335747911"
Jul 28 12:34:14.726502 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:14.726458    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-58s4v" podStartSLOduration=1.445108791 podStartE2EDuration="2.726449522s" totalImagesPullingTime="1.281340731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:14.726002281 +0000 UTC m=+263.335867980" watchObservedRunningTime="2026-07-28 12:34:14.726449522 +0000 UTC m=+263.336315230"
Jul 28 12:34:14.807097 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:14.807058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:15.717269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:15.716803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-2vpn2" event={"ID":"ce291cde-2d3b-4c5f-8246-814881b8c891","Type":"ContainerStarted","Data":"945dc83b3670daa717f54c13a130815ac09c1bfe0a73aded5c7dc9e032dc9479"}
Jul 28 12:34:15.719137 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:15.719061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg" event={"ID":"3e07272f-da7a-4f83-8feb-3721e38d02f6","Type":"ContainerStarted","Data":"5ea9d29f2d1fcc33158653b4c7a8f2bbcbd4df1edb8e1073046e08ab7980fb26"}
Jul 28 12:34:15.735241 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:15.735012    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-2vpn2" podStartSLOduration=1.080357908 podStartE2EDuration="3.734992649s" totalImagesPullingTime="2.654634741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:15.733957546 +0000 UTC m=+264.343823250" watchObservedRunningTime="2026-07-28 12:34:15.734992649 +0000 UTC m=+264.344858349"
Jul 28 12:34:15.754720 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:15.754545    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg" podStartSLOduration=1.113981531 podStartE2EDuration="3.754524885s" totalImagesPullingTime="2.640543354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:15.752742499 +0000 UTC m=+264.362608208" watchObservedRunningTime="2026-07-28 12:34:15.754524885 +0000 UTC m=+264.364390594"
Jul 28 12:34:16.195873 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.195836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:16.196074 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.195966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:16.196074 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.196026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:16.196074 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:16.196027    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:34:16.196244 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:16.196115    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:34:16.196244 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:16.196120    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls podName:ae267fd0-533b-4767-b974-5f174a5cfcbb nodeName:}" failed. No retries permitted until 2026-07-28 12:34:20.19610231 +0000 UTC m=+268.805968019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls") pod "cluster-samples-operator-6748489656-wchjd" (UID: "ae267fd0-533b-4767-b974-5f174a5cfcbb") : secret "samples-operator-tls" not found
Jul 28 12:34:16.196244 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:16.196142    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:20.196132806 +0000 UTC m=+268.805998492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : configmap references non-existent config key: service-ca.crt
Jul 28 12:34:16.196244 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:16.196162    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:20.196150383 +0000 UTC m=+268.806016068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : secret "router-metrics-certs-default" not found
Jul 28 12:34:16.420516 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.420467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:16.515490 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.515410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:16.572249 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.572223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:16.629174 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.628293    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pl55j"]
Jul 28 12:34:16.632059 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.632031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.634156 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.634059    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 12:34:16.634362 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.634341    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 12:34:16.634593 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.634563    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cv5n6\""
Jul 28 12:34:16.640999 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.640952    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pl55j"]
Jul 28 12:34:16.679825 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.679729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:16.701341 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.701316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.701483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.701407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l446\" (UniqueName: \"kubernetes.io/projected/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-api-access-5l446\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.701483 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.701433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c06f0b0d-03a0-4f54-bd8b-31db467ce298-crio-socket\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.701554 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.701485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c06f0b0d-03a0-4f54-bd8b-31db467ce298-data-volume\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.701586 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.701558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.723016 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.722961    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/0.log"
Jul 28 12:34:16.723333 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.723021    2565 generic.go:356] "Generic (PLEG): container finished" podID="3e07272f-da7a-4f83-8feb-3721e38d02f6" containerID="5ea9d29f2d1fcc33158653b4c7a8f2bbcbd4df1edb8e1073046e08ab7980fb26" exitCode=255
Jul 28 12:34:16.723333 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.723103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg" event={"ID":"3e07272f-da7a-4f83-8feb-3721e38d02f6","Type":"ContainerDied","Data":"5ea9d29f2d1fcc33158653b4c7a8f2bbcbd4df1edb8e1073046e08ab7980fb26"}
Jul 28 12:34:16.723411 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.723335    2565 scope.go:117] "RemoveContainer" containerID="5ea9d29f2d1fcc33158653b4c7a8f2bbcbd4df1edb8e1073046e08ab7980fb26"
Jul 28 12:34:16.745632 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.745579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:16.803499 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.802669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.803499 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.802747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l446\" (UniqueName: \"kubernetes.io/projected/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-api-access-5l446\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.803499 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.802821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c06f0b0d-03a0-4f54-bd8b-31db467ce298-crio-socket\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.803499 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.802891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c06f0b0d-03a0-4f54-bd8b-31db467ce298-data-volume\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.803499 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.802998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.803499 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:16.803086    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:34:16.803499 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:16.803142    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:17.303123845 +0000 UTC m=+265.912989534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : configmap "kube-rbac-proxy" not found
Jul 28 12:34:16.803499 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:16.803310    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:16.803499 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:16.803351    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:17.303336864 +0000 UTC m=+265.913202565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:16.804098 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.804000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c06f0b0d-03a0-4f54-bd8b-31db467ce298-data-volume\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.808895 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.808526    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c06f0b0d-03a0-4f54-bd8b-31db467ce298-crio-socket\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:16.811793 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:16.811771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l446\" (UniqueName: \"kubernetes.io/projected/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-api-access-5l446\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:17.307490 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:17.307463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:17.307683 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:17.307613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:17.307683 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:17.307646    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:17.307816 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:17.307700    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:34:17.307816 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:17.307703    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:18.307686072 +0000 UTC m=+266.917551775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:17.307816 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:17.307741    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:18.307730685 +0000 UTC m=+266.917596377 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : configmap "kube-rbac-proxy" not found
Jul 28 12:34:17.728153 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:17.728128    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:34:17.728577 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:17.728535    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/0.log"
Jul 28 12:34:17.728623 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:17.728570    2565 generic.go:356] "Generic (PLEG): container finished" podID="3e07272f-da7a-4f83-8feb-3721e38d02f6" containerID="463c7bfb406bef43b569ddf7ddec17b8350155f50820ecc02ad684af26780554" exitCode=255
Jul 28 12:34:17.728692 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:17.728668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg" event={"ID":"3e07272f-da7a-4f83-8feb-3721e38d02f6","Type":"ContainerDied","Data":"463c7bfb406bef43b569ddf7ddec17b8350155f50820ecc02ad684af26780554"}
Jul 28 12:34:17.728801 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:17.728780    2565 scope.go:117] "RemoveContainer" containerID="5ea9d29f2d1fcc33158653b4c7a8f2bbcbd4df1edb8e1073046e08ab7980fb26"
Jul 28 12:34:17.729002 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:17.728963    2565 scope.go:117] "RemoveContainer" containerID="463c7bfb406bef43b569ddf7ddec17b8350155f50820ecc02ad684af26780554"
Jul 28 12:34:17.729218 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:17.729195    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-8d6cg_openshift-console-operator(3e07272f-da7a-4f83-8feb-3721e38d02f6)\"" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg" podUID="3e07272f-da7a-4f83-8feb-3721e38d02f6"
Jul 28 12:34:17.730185 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:17.730139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q" event={"ID":"13271b45-4738-4235-bb1e-ddf00d89730b","Type":"ContainerStarted","Data":"bac7aa4dda1a780b5898851da3f2a2c67ff242d29669dad85a5cc81d0ea83d76"}
Jul 28 12:34:17.758032 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:17.757964    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q" podStartSLOduration=1.356951477 podStartE2EDuration="5.757947075s" totalImagesPullingTime="4.400995598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:17.757606508 +0000 UTC m=+266.367472219" watchObservedRunningTime="2026-07-28 12:34:17.757947075 +0000 UTC m=+266.367812782"
Jul 28 12:34:18.273678 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:18.273641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:18.317292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:18.317261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:18.317407 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:18.317310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:18.317407 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:18.317381    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:34:18.317479 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:18.317434    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:18.317479 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:18.317453    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:20.31743712 +0000 UTC m=+268.927302809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : configmap "kube-rbac-proxy" not found
Jul 28 12:34:18.317479 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:18.317469    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:20.317459148 +0000 UTC m=+268.927324833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:18.330012 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:18.329961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:18.699851 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:18.699813    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:18.733865 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:18.733841    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:34:18.734344 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:18.734326    2565 scope.go:117] "RemoveContainer" containerID="463c7bfb406bef43b569ddf7ddec17b8350155f50820ecc02ad684af26780554"
Jul 28 12:34:18.734487 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:18.734470    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-8d6cg_openshift-console-operator(3e07272f-da7a-4f83-8feb-3721e38d02f6)\"" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg" podUID="3e07272f-da7a-4f83-8feb-3721e38d02f6"
Jul 28 12:34:18.979358 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:18.979257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:19.082756 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:19.082725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:19.208837 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:19.208800    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:19.267336 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:19.267251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:19.628299 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:19.628226    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wgj9h_c6622717-f1dd-4632-8535-16a44cceb950/dns-node-resolver/0.log"
Jul 28 12:34:20.228017 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.227971    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b8f4r_e4f78aa3-8acd-41e7-8cc4-2e33c3938634/node-ca/0.log"
Jul 28 12:34:20.235456 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.235435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:20.235594 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.235476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:20.235594 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.235526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:20.235706 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:20.235595    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 12:34:20.235706 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:20.235661    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:28.235640943 +0000 UTC m=+276.845506646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : secret "router-metrics-certs-default" not found
Jul 28 12:34:20.235706 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:20.235662    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 28 12:34:20.235861 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:20.235710    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls podName:ae267fd0-533b-4767-b974-5f174a5cfcbb nodeName:}" failed. No retries permitted until 2026-07-28 12:34:28.235700088 +0000 UTC m=+276.845565777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls") pod "cluster-samples-operator-6748489656-wchjd" (UID: "ae267fd0-533b-4767-b974-5f174a5cfcbb") : secret "samples-operator-tls" not found
Jul 28 12:34:20.235861 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:20.235765    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:28.235753055 +0000 UTC m=+276.845618745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : configmap references non-existent config key: service-ca.crt
Jul 28 12:34:20.336515 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.336484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:20.336668 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.336623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:20.336668 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:20.336634    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:20.336763 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:20.336690    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:24.336673855 +0000 UTC m=+272.946539558 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:20.336763 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:20.336705    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:34:20.336763 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:20.336739    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:24.336726748 +0000 UTC m=+272.946592435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : configmap "kube-rbac-proxy" not found
Jul 28 12:34:20.577239 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.577153    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-6n5q5"]
Jul 28 12:34:20.580302 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.580280    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:20.582595 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.582573    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 12:34:20.582595 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.582574    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 12:34:20.582756 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.582637    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dg2nm\""
Jul 28 12:34:20.583102 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.583088    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 12:34:20.583203 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.583186    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 12:34:20.587916 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.587896    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-6n5q5"]
Jul 28 12:34:20.612606 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.612566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:20.639765 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.639733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fszkm\" (UniqueName: \"kubernetes.io/projected/238f1909-394b-4c1c-9c75-298820e12b7b-kube-api-access-fszkm\") pod \"service-ca-658d7b7c78-6n5q5\" (UID: \"238f1909-394b-4c1c-9c75-298820e12b7b\") " pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:20.639915 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.639798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/238f1909-394b-4c1c-9c75-298820e12b7b-signing-key\") pod \"service-ca-658d7b7c78-6n5q5\" (UID: \"238f1909-394b-4c1c-9c75-298820e12b7b\") " pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:20.639915 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.639861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/238f1909-394b-4c1c-9c75-298820e12b7b-signing-cabundle\") pod \"service-ca-658d7b7c78-6n5q5\" (UID: \"238f1909-394b-4c1c-9c75-298820e12b7b\") " pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:20.669665 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.669637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:20.740299 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.740271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/238f1909-394b-4c1c-9c75-298820e12b7b-signing-cabundle\") pod \"service-ca-658d7b7c78-6n5q5\" (UID: \"238f1909-394b-4c1c-9c75-298820e12b7b\") " pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:20.740419 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.740344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fszkm\" (UniqueName: \"kubernetes.io/projected/238f1909-394b-4c1c-9c75-298820e12b7b-kube-api-access-fszkm\") pod \"service-ca-658d7b7c78-6n5q5\" (UID: \"238f1909-394b-4c1c-9c75-298820e12b7b\") " pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:20.740419 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.740385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/238f1909-394b-4c1c-9c75-298820e12b7b-signing-key\") pod \"service-ca-658d7b7c78-6n5q5\" (UID: \"238f1909-394b-4c1c-9c75-298820e12b7b\") " pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:20.740860 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.740837    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/238f1909-394b-4c1c-9c75-298820e12b7b-signing-cabundle\") pod \"service-ca-658d7b7c78-6n5q5\" (UID: \"238f1909-394b-4c1c-9c75-298820e12b7b\") " pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:20.742875 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.742852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/238f1909-394b-4c1c-9c75-298820e12b7b-signing-key\") pod \"service-ca-658d7b7c78-6n5q5\" (UID: \"238f1909-394b-4c1c-9c75-298820e12b7b\") " pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:20.748374 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.748355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fszkm\" (UniqueName: \"kubernetes.io/projected/238f1909-394b-4c1c-9c75-298820e12b7b-kube-api-access-fszkm\") pod \"service-ca-658d7b7c78-6n5q5\" (UID: \"238f1909-394b-4c1c-9c75-298820e12b7b\") " pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:20.888892 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:20.888814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5"
Jul 28 12:34:21.013686 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:21.013658    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-6n5q5"]
Jul 28 12:34:21.016324 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:21.016294    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238f1909_394b_4c1c_9c75_298820e12b7b.slice/crio-0d1ebbf10df424c5d5ca82a30ad0cdb7f272de147b287ec14b16a92d2dd4baef WatchSource:0}: Error finding container 0d1ebbf10df424c5d5ca82a30ad0cdb7f272de147b287ec14b16a92d2dd4baef: Status 404 returned error can't find the container with id 0d1ebbf10df424c5d5ca82a30ad0cdb7f272de147b287ec14b16a92d2dd4baef
Jul 28 12:34:21.429626 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:21.429586    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlfr9_4fbdc23a-ddae-4e43-a918-6386d294be86/serve-healthcheck-canary/0.log"
Jul 28 12:34:21.577107 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:21.577071    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:21.744623 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:21.744583    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5" event={"ID":"238f1909-394b-4c1c-9c75-298820e12b7b","Type":"ContainerStarted","Data":"5c02e610375e21ee2e832821122e60e2fd8684616eb9193d6266c0b0c092303e"}
Jul 28 12:34:21.744806 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:21.744669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5" event={"ID":"238f1909-394b-4c1c-9c75-298820e12b7b","Type":"ContainerStarted","Data":"0d1ebbf10df424c5d5ca82a30ad0cdb7f272de147b287ec14b16a92d2dd4baef"}
Jul 28 12:34:21.760914 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:21.760647    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-6n5q5" podStartSLOduration=1.760627601 podStartE2EDuration="1.760627601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:21.760569523 +0000 UTC m=+270.370435232" watchObservedRunningTime="2026-07-28 12:34:21.760627601 +0000 UTC m=+270.370493311"
Jul 28 12:34:22.655295 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:22.655208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:22.794795 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:22.793819    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:22.794795 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:22.794287    2565 scope.go:117] "RemoveContainer" containerID="463c7bfb406bef43b569ddf7ddec17b8350155f50820ecc02ad684af26780554"
Jul 28 12:34:22.794795 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:22.794460    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-8d6cg_openshift-console-operator(3e07272f-da7a-4f83-8feb-3721e38d02f6)\"" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg" podUID="3e07272f-da7a-4f83-8feb-3721e38d02f6"
Jul 28 12:34:22.867161 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:22.867103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:22.979574 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:22.979540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:23.041046 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:23.041016    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:23.207678 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:23.207634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:23.309102 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:23.309024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:23.407140 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:23.407109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:23.952253 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:23.952224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:24.371310 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:24.371218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:24.371465 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:24.371336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:24.371465 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:24.371373    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:24.371465 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:24.371419    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:34:24.371465 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:24.371449    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:32.371431633 +0000 UTC m=+280.981297330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:24.371465 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:24.371466    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:32.371459454 +0000 UTC m=+280.981325144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : configmap "kube-rbac-proxy" not found
Jul 28 12:34:24.552012 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:24.551968    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:24.795312 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:24.795271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:25.141653 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:25.141562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:25.719913 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:25.719884    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:25.720286 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:25.720273    2565 scope.go:117] "RemoveContainer" containerID="463c7bfb406bef43b569ddf7ddec17b8350155f50820ecc02ad684af26780554"
Jul 28 12:34:25.720438 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:25.720420    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-8d6cg_openshift-console-operator(3e07272f-da7a-4f83-8feb-3721e38d02f6)\"" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg" podUID="3e07272f-da7a-4f83-8feb-3721e38d02f6"
Jul 28 12:34:26.654059 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:26.654012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:26.714384 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:26.714343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:26.952716 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:26.952683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:27.343919 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:27.343828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:27.538351 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:27.538313    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:27.940081 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:27.940043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:28.307247 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:28.307208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:28.307422 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:28.307269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:28.307422 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:28.307372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:28.307422 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:28.307397    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle podName:fbb8f4a1-6686-49ee-9e82-88cf65d64996 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:44.307375659 +0000 UTC m=+292.917241371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle") pod "router-default-b5489f54f-lfkkv" (UID: "fbb8f4a1-6686-49ee-9e82-88cf65d64996") : configmap references non-existent config key: service-ca.crt
Jul 28 12:34:28.309887 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:28.309855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae267fd0-533b-4767-b974-5f174a5cfcbb-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wchjd\" (UID: \"ae267fd0-533b-4767-b974-5f174a5cfcbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:28.310011 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:28.309897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbb8f4a1-6686-49ee-9e82-88cf65d64996-metrics-certs\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:28.594947 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:28.594848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"
Jul 28 12:34:28.721337 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:28.721305    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd"]
Jul 28 12:34:28.739000 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:28.738950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:28.767250 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:28.767220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd" event={"ID":"ae267fd0-533b-4767-b974-5f174a5cfcbb","Type":"ContainerStarted","Data":"ea83b97b7cb3bc735ce653412949d005037b3298d4ce4134fa0c184747ca7612"}
Jul 28 12:34:28.942538 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:28.942444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:29.131459 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:29.131422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:29.346363 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:29.346331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:29.537321 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:29.537289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:31.069486 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:31.069445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:31.171458 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:31.171420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:31.271856 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:31.271817    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:31.372085 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:31.372006    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:31.779466 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:31.779433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd" event={"ID":"ae267fd0-533b-4767-b974-5f174a5cfcbb","Type":"ContainerStarted","Data":"ea36a201848535ea0e3ed81e711b2e86ec8fca0fcbb317d4c976f3032ff792c4"}
Jul 28 12:34:32.445360 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:32.445309    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr" podUID="f0b2325f-97cb-47d9-b60e-501fe53c3fab"
Jul 28 12:34:32.445360 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:32.445309    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm" podUID="9da533a3-e5e5-424a-bc79-7746d876a327"
Jul 28 12:34:32.445789 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:32.445372    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w9z87" podUID="6bd4e8d2-1e75-4009-8aad-b916a0bb6266"
Jul 28 12:34:32.445789 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:32.445513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:32.445789 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:32.445563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:32.445789 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:32.445663    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:32.445789 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:32.445713    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls podName:c06f0b0d-03a0-4f54-bd8b-31db467ce298 nodeName:}" failed. No retries permitted until 2026-07-28 12:34:48.445700374 +0000 UTC m=+297.055566061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pl55j" (UID: "c06f0b0d-03a0-4f54-bd8b-31db467ce298") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:34:32.446028 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:32.446011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c06f0b0d-03a0-4f54-bd8b-31db467ce298-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:32.784237 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:32.784166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:34:32.784237 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:32.784201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd" event={"ID":"ae267fd0-533b-4767-b974-5f174a5cfcbb","Type":"ContainerStarted","Data":"e39d915d361231186c9446ea1c3d3f2bef4591ea7465919e952f0ccb9e75bb81"}
Jul 28 12:34:32.784402 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:32.784321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9z87"
Jul 28 12:34:32.784481 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:32.784466    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:34:32.798491 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:32.798432    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wchjd" podStartSLOduration=17.856018761 podStartE2EDuration="20.798417564s" totalImagesPullingTime="2.942398803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:32.798073057 +0000 UTC m=+281.407938755" watchObservedRunningTime="2026-07-28 12:34:32.798417564 +0000 UTC m=+281.408283260"
Jul 28 12:34:33.042174 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:33.042093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:33.102186 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:33.102133    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:33.277137 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:33.277107    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:33.378616 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:33.378542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:33.446131 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:33.446103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:36.276222 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.276190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:34:36.276692 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.276252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:34:36.276692 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.276369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:34:36.278687 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.278655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6bd4e8d2-1e75-4009-8aad-b916a0bb6266-metrics-tls\") pod \"dns-default-w9z87\" (UID: \"6bd4e8d2-1e75-4009-8aad-b916a0bb6266\") " pod="openshift-dns/dns-default-w9z87"
Jul 28 12:34:36.278790 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.278741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9da533a3-e5e5-424a-bc79-7746d876a327-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-6bldm\" (UID: \"9da533a3-e5e5-424a-bc79-7746d876a327\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:34:36.278887 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.278865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"image-registry-7c9d6c6f45-gw7fr\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") " pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:34:36.387862 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.387833    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b6hh6\""
Jul 28 12:34:36.387862 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.387834    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bstgx\""
Jul 28 12:34:36.388075 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.387874    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nfll9\""
Jul 28 12:34:36.396304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.396277    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w9z87"
Jul 28 12:34:36.396304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.396296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:34:36.396453 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.396317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"
Jul 28 12:34:36.578393 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.578362    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w9z87"]
Jul 28 12:34:36.581938 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:36.581829    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd4e8d2_1e75_4009_8aad_b916a0bb6266.slice/crio-ece060fd55fbc6f3a03aa5d01e5498183820321d73ec16c6a88eac5b5da40ff6 WatchSource:0}: Error finding container ece060fd55fbc6f3a03aa5d01e5498183820321d73ec16c6a88eac5b5da40ff6: Status 404 returned error can't find the container with id ece060fd55fbc6f3a03aa5d01e5498183820321d73ec16c6a88eac5b5da40ff6
Jul 28 12:34:36.581938 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.581913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"]
Jul 28 12:34:36.584237 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:36.584213    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b2325f_97cb_47d9_b60e_501fe53c3fab.slice/crio-e57dfac2fe2e50d30d840283100256c18e9f7b030cc573dde7496c41468fe61d WatchSource:0}: Error finding container e57dfac2fe2e50d30d840283100256c18e9f7b030cc573dde7496c41468fe61d: Status 404 returned error can't find the container with id e57dfac2fe2e50d30d840283100256c18e9f7b030cc573dde7496c41468fe61d
Jul 28 12:34:36.594316 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.594294    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-6bldm"]
Jul 28 12:34:36.597650 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:36.597625    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da533a3_e5e5_424a_bc79_7746d876a327.slice/crio-96cc17b9f4d79ceaadc85d1ddbcc246eb213e5405dd90dd9d4562c5791043488 WatchSource:0}: Error finding container 96cc17b9f4d79ceaadc85d1ddbcc246eb213e5405dd90dd9d4562c5791043488: Status 404 returned error can't find the container with id 96cc17b9f4d79ceaadc85d1ddbcc246eb213e5405dd90dd9d4562c5791043488
Jul 28 12:34:36.797757 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.797670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm" event={"ID":"9da533a3-e5e5-424a-bc79-7746d876a327","Type":"ContainerStarted","Data":"96cc17b9f4d79ceaadc85d1ddbcc246eb213e5405dd90dd9d4562c5791043488"}
Jul 28 12:34:36.799159 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.799128    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr" event={"ID":"f0b2325f-97cb-47d9-b60e-501fe53c3fab","Type":"ContainerStarted","Data":"d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794"}
Jul 28 12:34:36.799290 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.799169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr" event={"ID":"f0b2325f-97cb-47d9-b60e-501fe53c3fab","Type":"ContainerStarted","Data":"e57dfac2fe2e50d30d840283100256c18e9f7b030cc573dde7496c41468fe61d"}
Jul 28 12:34:36.799290 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.799194    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:34:36.800258 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.800235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9z87" event={"ID":"6bd4e8d2-1e75-4009-8aad-b916a0bb6266","Type":"ContainerStarted","Data":"ece060fd55fbc6f3a03aa5d01e5498183820321d73ec16c6a88eac5b5da40ff6"}
Jul 28 12:34:36.817868 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.817816    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr" podStartSLOduration=284.817801985 podStartE2EDuration="4m44.817801985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:36.81739262 +0000 UTC m=+285.427258675" watchObservedRunningTime="2026-07-28 12:34:36.817801985 +0000 UTC m=+285.427667692"
Jul 28 12:34:36.893817 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:36.893790    2565 scope.go:117] "RemoveContainer" containerID="463c7bfb406bef43b569ddf7ddec17b8350155f50820ecc02ad684af26780554"
Jul 28 12:34:37.629769 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:37.629717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:37.730892 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:37.730861    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:37.786738 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:37.786702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:37.807202 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:37.807173    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:34:37.808081 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:37.807550    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg" event={"ID":"3e07272f-da7a-4f83-8feb-3721e38d02f6","Type":"ContainerStarted","Data":"6f656e69af5955e57c4d1230a14c8c47af43bd85bc95f8dff0fb12285cbca01c"}
Jul 28 12:34:37.808081 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:37.807886    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:37.814037 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:37.814013    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-8d6cg"
Jul 28 12:34:38.119278 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:38.119241    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:38.182363 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:38.182330    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:38.275307 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:38.275252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:38.374684 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:38.374598    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:38.812515 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:38.812479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9z87" event={"ID":"6bd4e8d2-1e75-4009-8aad-b916a0bb6266","Type":"ContainerStarted","Data":"c011240c03baa34835796ab48c1a88343a5566ef2276daa91dbcb4c69abd531d"}
Jul 28 12:34:38.812901 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:38.812527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w9z87" event={"ID":"6bd4e8d2-1e75-4009-8aad-b916a0bb6266","Type":"ContainerStarted","Data":"7dcd2d63f53b054c44faf69ffc6eaa799ba5865e89a48acc229323ec4d5f4fff"}
Jul 28 12:34:38.812901 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:38.812593    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w9z87"
Jul 28 12:34:38.813964 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:38.813942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm" event={"ID":"9da533a3-e5e5-424a-bc79-7746d876a327","Type":"ContainerStarted","Data":"19563a9d43fbf1ed9f09161e7f6415e23c5b35f7bab68baeaf6585c283694af0"}
Jul 28 12:34:38.828562 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:38.828520    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w9z87" podStartSLOduration=250.955314191 podStartE2EDuration="4m12.828507532s" totalImagesPullingTime="1.873193341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:38.826973759 +0000 UTC m=+287.436839478" watchObservedRunningTime="2026-07-28 12:34:38.828507532 +0000 UTC m=+287.438373262"
Jul 28 12:34:38.841462 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:38.841418    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-6bldm" podStartSLOduration=266.988757639 podStartE2EDuration="4m28.84140259s" totalImagesPullingTime="1.852644951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:38.840718121 +0000 UTC m=+287.450583828" watchObservedRunningTime="2026-07-28 12:34:38.84140259 +0000 UTC m=+287.451268317"
Jul 28 12:34:39.139588 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:39.139557    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:39.190257 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:39.190227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:39.316900 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:39.316871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:39.532521 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:39.532484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:39.780694 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:39.780659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:42.700589 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.700563    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-tdd9f"]
Jul 28 12:34:42.702451 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.702432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-tdd9f"
Jul 28 12:34:42.704362 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.704311    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 12:34:42.704503 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.704464    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 12:34:42.705047 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.704942    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-slqks\""
Jul 28 12:34:42.714593 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.714574    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-tdd9f"]
Jul 28 12:34:42.778502 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.778470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:42.826800 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.826772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf5vb\" (UniqueName: \"kubernetes.io/projected/a9295418-b56a-4559-82cd-1bc2e54c47e7-kube-api-access-bf5vb\") pod \"downloads-7c97dc4555-tdd9f\" (UID: \"a9295418-b56a-4559-82cd-1bc2e54c47e7\") " pod="openshift-console/downloads-7c97dc4555-tdd9f"
Jul 28 12:34:42.879220 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.879177    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:42.927432 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.927406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf5vb\" (UniqueName: \"kubernetes.io/projected/a9295418-b56a-4559-82cd-1bc2e54c47e7-kube-api-access-bf5vb\") pod \"downloads-7c97dc4555-tdd9f\" (UID: \"a9295418-b56a-4559-82cd-1bc2e54c47e7\") " pod="openshift-console/downloads-7c97dc4555-tdd9f"
Jul 28 12:34:42.937933 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.937904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf5vb\" (UniqueName: \"kubernetes.io/projected/a9295418-b56a-4559-82cd-1bc2e54c47e7-kube-api-access-bf5vb\") pod \"downloads-7c97dc4555-tdd9f\" (UID: \"a9295418-b56a-4559-82cd-1bc2e54c47e7\") " pod="openshift-console/downloads-7c97dc4555-tdd9f"
Jul 28 12:34:42.978908 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:42.978840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:43.011928 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:43.011900    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-tdd9f"
Jul 28 12:34:43.139022 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:43.138972    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-tdd9f"]
Jul 28 12:34:43.142311 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:43.142288    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9295418_b56a_4559_82cd_1bc2e54c47e7.slice/crio-f4ea91c66fb0a039eb02b58743ccc36c76918fa9018f1b5d8bff8cbe583e7654 WatchSource:0}: Error finding container f4ea91c66fb0a039eb02b58743ccc36c76918fa9018f1b5d8bff8cbe583e7654: Status 404 returned error can't find the container with id f4ea91c66fb0a039eb02b58743ccc36c76918fa9018f1b5d8bff8cbe583e7654
Jul 28 12:34:43.834303 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:43.834260    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-tdd9f" event={"ID":"a9295418-b56a-4559-82cd-1bc2e54c47e7","Type":"ContainerStarted","Data":"f4ea91c66fb0a039eb02b58743ccc36c76918fa9018f1b5d8bff8cbe583e7654"}
Jul 28 12:34:44.340390 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:44.340359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:44.341033 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:44.341013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fbb8f4a1-6686-49ee-9e82-88cf65d64996-service-ca-bundle\") pod \"router-default-b5489f54f-lfkkv\" (UID: \"fbb8f4a1-6686-49ee-9e82-88cf65d64996\") " pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:44.516921 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:44.516884    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:44.661662 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:44.661633    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b5489f54f-lfkkv"]
Jul 28 12:34:44.664966 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:44.664940    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb8f4a1_6686_49ee_9e82_88cf65d64996.slice/crio-c7149ddb181f7242680df8ef7db28d813b6dac7e59dad68ba01c1068d0fc7e46 WatchSource:0}: Error finding container c7149ddb181f7242680df8ef7db28d813b6dac7e59dad68ba01c1068d0fc7e46: Status 404 returned error can't find the container with id c7149ddb181f7242680df8ef7db28d813b6dac7e59dad68ba01c1068d0fc7e46
Jul 28 12:34:44.841664 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:44.841626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b5489f54f-lfkkv" event={"ID":"fbb8f4a1-6686-49ee-9e82-88cf65d64996","Type":"ContainerStarted","Data":"778c00761cd872a957fd805bcab2cd3494fb3699941c68302e6feaa2311c6be3"}
Jul 28 12:34:44.842135 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:44.841686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b5489f54f-lfkkv" event={"ID":"fbb8f4a1-6686-49ee-9e82-88cf65d64996","Type":"ContainerStarted","Data":"c7149ddb181f7242680df8ef7db28d813b6dac7e59dad68ba01c1068d0fc7e46"}
Jul 28 12:34:44.872744 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:44.872638    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-b5489f54f-lfkkv" podStartSLOduration=32.872617108 podStartE2EDuration="32.872617108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:34:44.87162195 +0000 UTC m=+293.481487659" watchObservedRunningTime="2026-07-28 12:34:44.872617108 +0000 UTC m=+293.482482873"
Jul 28 12:34:44.895924 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:34:44.895877    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l9cdv" podUID="00ead778-8308-459e-9361-5091cc6b8849"
Jul 28 12:34:45.517534 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:45.517498    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:45.520429 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:45.520388    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:45.846825 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:45.846751    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:45.848076 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:45.848057    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b5489f54f-lfkkv"
Jul 28 12:34:46.549461 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:46.549378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:46.605612 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:46.605582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:46.792232 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:46.792196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:46.890389 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:46.890311    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:46.977203 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:46.977168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:47.457169 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:47.457131    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:48.477411 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:48.477375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:48.480021 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:48.479971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c06f0b0d-03a0-4f54-bd8b-31db467ce298-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pl55j\" (UID: \"c06f0b0d-03a0-4f54-bd8b-31db467ce298\") " pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:48.744732 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:48.744647    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pl55j"
Jul 28 12:34:48.820531 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:48.820490    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w9z87"
Jul 28 12:34:48.894873 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:48.894775    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pl55j"]
Jul 28 12:34:48.897734 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:34:48.897708    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06f0b0d_03a0_4f54_bd8b_31db467ce298.slice/crio-3a45d06e94e6588f68f2fff047cbbb89ad00baa947cd5520ce2cf80d84cfef08 WatchSource:0}: Error finding container 3a45d06e94e6588f68f2fff047cbbb89ad00baa947cd5520ce2cf80d84cfef08: Status 404 returned error can't find the container with id 3a45d06e94e6588f68f2fff047cbbb89ad00baa947cd5520ce2cf80d84cfef08
Jul 28 12:34:49.866678 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:49.866638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl55j" event={"ID":"c06f0b0d-03a0-4f54-bd8b-31db467ce298","Type":"ContainerStarted","Data":"3a45d06e94e6588f68f2fff047cbbb89ad00baa947cd5520ce2cf80d84cfef08"}
Jul 28 12:34:51.987824 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:51.987789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:52.025652 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.025618    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"]
Jul 28 12:34:52.028351 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.028329    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.036878 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.032677    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 12:34:52.036878 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.032807    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 12:34:52.036878 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.033063    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 12:34:52.036878 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.033841    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 12:34:52.036878 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.034508    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7x2tq\""
Jul 28 12:34:52.036878 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.034945    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 12:34:52.044093 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.043931    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"]
Jul 28 12:34:52.090766 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.090651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:52.111940 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.111896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae8a0dc-1624-4782-b1b4-44e8cb634c56-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.112138 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.112093    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbtx2\" (UniqueName: \"kubernetes.io/projected/eae8a0dc-1624-4782-b1b4-44e8cb634c56-kube-api-access-fbtx2\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.112138 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.112125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae8a0dc-1624-4782-b1b4-44e8cb634c56-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.112253 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.112165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eae8a0dc-1624-4782-b1b4-44e8cb634c56-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.179423 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.179385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:52.213222 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.213193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbtx2\" (UniqueName: \"kubernetes.io/projected/eae8a0dc-1624-4782-b1b4-44e8cb634c56-kube-api-access-fbtx2\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.213222 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.213224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae8a0dc-1624-4782-b1b4-44e8cb634c56-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.213452 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.213252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eae8a0dc-1624-4782-b1b4-44e8cb634c56-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.213452 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.213285    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae8a0dc-1624-4782-b1b4-44e8cb634c56-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.214340 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.214156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eae8a0dc-1624-4782-b1b4-44e8cb634c56-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.216523 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.216491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eae8a0dc-1624-4782-b1b4-44e8cb634c56-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.216523 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.216506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eae8a0dc-1624-4782-b1b4-44e8cb634c56-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.221154 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.221129    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbtx2\" (UniqueName: \"kubernetes.io/projected/eae8a0dc-1624-4782-b1b4-44e8cb634c56-kube-api-access-fbtx2\") pod \"prometheus-operator-84d69f794d-tx6h6\" (UID: \"eae8a0dc-1624-4782-b1b4-44e8cb634c56\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.342634 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.342560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"
Jul 28 12:34:52.947842 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:52.947804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:53.002051 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:53.002017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:55.816542 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:55.816508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:56.402122 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:56.402083    2565 patch_prober.go:28] interesting pod/image-registry-7c9d6c6f45-gw7fr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 12:34:56.402319 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:56.402162    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr" podUID="f0b2325f-97cb-47d9-b60e-501fe53c3fab" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 12:34:56.893694 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:56.893667    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:34:57.244061 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:57.244014    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:57.813842 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:57.813818    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:34:57.945590 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:57.945542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:57.996351 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:57.996297    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:58.095748 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:58.095664    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:58.196507 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:58.196447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:58.296241 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:58.296187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:59.541541 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:59.541507    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:34:59.642725 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:34:59.642689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:00.415641 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:00.415553    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:00.512704 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:00.512673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:00.612621 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:00.612533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:01.368547 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.368522    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:35:01.369431 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.369343    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:35:01.381400 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.381379    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 12:35:01.482688 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.482659    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-tx6h6"]
Jul 28 12:35:01.485820 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:35:01.485795    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae8a0dc_1624_4782_b1b4_44e8cb634c56.slice/crio-a066af11b722a18fb64aed443d29e1f050764ada85422da9588ebd8b85fc3e8b WatchSource:0}: Error finding container a066af11b722a18fb64aed443d29e1f050764ada85422da9588ebd8b85fc3e8b: Status 404 returned error can't find the container with id a066af11b722a18fb64aed443d29e1f050764ada85422da9588ebd8b85fc3e8b
Jul 28 12:35:01.487758 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.487731    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 12:35:01.916078 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.915939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-tdd9f" event={"ID":"a9295418-b56a-4559-82cd-1bc2e54c47e7","Type":"ContainerStarted","Data":"b5abd05abc80e552cd9a3a15c854355a793e9283ea9eb19d41322921eebfab42"}
Jul 28 12:35:01.916544 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.916412    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-tdd9f"
Jul 28 12:35:01.919949 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.919912    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6" event={"ID":"eae8a0dc-1624-4782-b1b4-44e8cb634c56","Type":"ContainerStarted","Data":"a066af11b722a18fb64aed443d29e1f050764ada85422da9588ebd8b85fc3e8b"}
Jul 28 12:35:01.921675 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.921645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl55j" event={"ID":"c06f0b0d-03a0-4f54-bd8b-31db467ce298","Type":"ContainerStarted","Data":"427e2cdfa959d72b2cc68fbbeea1b48677c4d01a058c2a1ed44030c36923b38e"}
Jul 28 12:35:01.929500 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.929481    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-tdd9f"
Jul 28 12:35:01.933180 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:01.933132    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-tdd9f" podStartSLOduration=1.5991041620000002 podStartE2EDuration="19.933112989s" totalImagesPullingTime="18.334008827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:01.931586657 +0000 UTC m=+310.541452365" watchObservedRunningTime="2026-07-28 12:35:01.933112989 +0000 UTC m=+310.542978700"
Jul 28 12:35:03.932885 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:03.932839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6" event={"ID":"eae8a0dc-1624-4782-b1b4-44e8cb634c56","Type":"ContainerStarted","Data":"cbdfc7aa4f709eee2bd8736754756c9f8e7f96e91e4bd1ea7cbad08caf82ed52"}
Jul 28 12:35:03.954098 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:03.954030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:04.094651 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:04.094619    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:04.196170 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:04.196133    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:04.253840 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:04.253756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:04.572274 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:04.570708    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"]
Jul 28 12:35:04.645789 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:04.645752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:04.746232 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:04.746155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:05.952521 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:05.952473    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:06.053896 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:06.053856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:06.759393 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:06.759322    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:06.860916 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:06.860869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:06.948588 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:06.948548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6" event={"ID":"eae8a0dc-1624-4782-b1b4-44e8cb634c56","Type":"ContainerStarted","Data":"1f545fe69955ded6f8e6b061c162335581b161b372d85234641e7e27e549d4c5"}
Jul 28 12:35:06.968846 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:06.968796    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-tx6h6" podStartSLOduration=12.768650171 podStartE2EDuration="14.9687821s" totalImagesPullingTime="2.200131929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:06.96707098 +0000 UTC m=+315.576936712" watchObservedRunningTime="2026-07-28 12:35:06.9687821 +0000 UTC m=+315.578647808"
Jul 28 12:35:07.954353 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:07.954318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl55j" event={"ID":"c06f0b0d-03a0-4f54-bd8b-31db467ce298","Type":"ContainerStarted","Data":"32363fa1872ae4f75c5fe44555fa2ced979bb2504b5a88033f2152f75ae19440"}
Jul 28 12:35:08.148021 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.147961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:08.342196 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.342111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:08.436240 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.436204    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dgkfv"]
Jul 28 12:35:08.465816 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.465787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:08.486620 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.486586    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.489108 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.489085    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 12:35:08.489259 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.489237    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xd6th\""
Jul 28 12:35:08.489341 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.489311    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 12:35:08.489480 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.489464    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 12:35:08.552725 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.552655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:08.555749 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.555716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-tls\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.555886 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.555783    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/944d0e7f-2605-4e55-89af-ef93adf5de79-root\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.555886 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.555816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-wtmp\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.555886 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.555847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jthk\" (UniqueName: \"kubernetes.io/projected/944d0e7f-2605-4e55-89af-ef93adf5de79-kube-api-access-9jthk\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.555886 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.555874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/944d0e7f-2605-4e55-89af-ef93adf5de79-sys\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.556142 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.555922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-textfile\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.556142 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.555947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.556142 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.555991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/944d0e7f-2605-4e55-89af-ef93adf5de79-metrics-client-ca\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.556142 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.556016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.656723 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.656643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-wtmp\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.656723 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.656703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jthk\" (UniqueName: \"kubernetes.io/projected/944d0e7f-2605-4e55-89af-ef93adf5de79-kube-api-access-9jthk\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.656932 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.656737    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/944d0e7f-2605-4e55-89af-ef93adf5de79-sys\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.656932 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.656798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-textfile\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.656932 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.656823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.656932 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.656852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/944d0e7f-2605-4e55-89af-ef93adf5de79-metrics-client-ca\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.656932 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.656877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.656932 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.656906    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-tls\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.657249 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.656964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/944d0e7f-2605-4e55-89af-ef93adf5de79-root\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.657249 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.657071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/944d0e7f-2605-4e55-89af-ef93adf5de79-root\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.657249 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.657211    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-wtmp\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.657588 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.657565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/944d0e7f-2605-4e55-89af-ef93adf5de79-sys\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.658740 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.658282    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/944d0e7f-2605-4e55-89af-ef93adf5de79-metrics-client-ca\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.658840 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.658332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-accelerators-collector-config\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.658840 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.658448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-textfile\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.660902 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.660880    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.666285 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.666151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/944d0e7f-2605-4e55-89af-ef93adf5de79-node-exporter-tls\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.669702 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.669626    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jthk\" (UniqueName: \"kubernetes.io/projected/944d0e7f-2605-4e55-89af-ef93adf5de79-kube-api-access-9jthk\") pod \"node-exporter-dgkfv\" (UID: \"944d0e7f-2605-4e55-89af-ef93adf5de79\") " pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.752013 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.751561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:08.799728 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.799524    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dgkfv"
Jul 28 12:35:08.842610 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:35:08.842033    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944d0e7f_2605_4e55_89af_ef93adf5de79.slice/crio-54e47b9e2eb96ae93ba6d514abfa7337248d3e7e479280a20b33a05d7f19e1aa WatchSource:0}: Error finding container 54e47b9e2eb96ae93ba6d514abfa7337248d3e7e479280a20b33a05d7f19e1aa: Status 404 returned error can't find the container with id 54e47b9e2eb96ae93ba6d514abfa7337248d3e7e479280a20b33a05d7f19e1aa
Jul 28 12:35:08.851431 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.851401    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:08.952605 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.952343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:08.962148 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:08.962078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgkfv" event={"ID":"944d0e7f-2605-4e55-89af-ef93adf5de79","Type":"ContainerStarted","Data":"54e47b9e2eb96ae93ba6d514abfa7337248d3e7e479280a20b33a05d7f19e1aa"}
Jul 28 12:35:09.377046 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:09.376078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:09.474389 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:09.474015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:09.573955 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:09.573904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:09.882196 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:09.882138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:10.974522 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:10.974491    2565 generic.go:356] "Generic (PLEG): container finished" podID="944d0e7f-2605-4e55-89af-ef93adf5de79" containerID="6398b85b7c56f05f6e08ae1782cd3868f0c0cfe3ae657f4fed60af368770aa50" exitCode=0
Jul 28 12:35:10.974940 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:10.974576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgkfv" event={"ID":"944d0e7f-2605-4e55-89af-ef93adf5de79","Type":"ContainerDied","Data":"6398b85b7c56f05f6e08ae1782cd3868f0c0cfe3ae657f4fed60af368770aa50"}
Jul 28 12:35:11.325632 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:11.325601    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:11.425375 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:11.425291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:11.485839 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:11.485762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:11.575676 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:11.575631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:11.981814 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:11.981782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgkfv" event={"ID":"944d0e7f-2605-4e55-89af-ef93adf5de79","Type":"ContainerStarted","Data":"a317877150b650b6124a397f86f96b20516f8cea56159fdf56881be9a77c2159"}
Jul 28 12:35:11.982303 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:11.981833    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dgkfv" event={"ID":"944d0e7f-2605-4e55-89af-ef93adf5de79","Type":"ContainerStarted","Data":"230eadce98e8a3d511bce24b47f8ad07844ef4449def3c09d6d840d353d6188a"}
Jul 28 12:35:12.001440 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.001383    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dgkfv" podStartSLOduration=2.135990313 podStartE2EDuration="4.001361443s" totalImagesPullingTime="1.752803268s" totalInitContainerRuntime="112.567862ms" isStatefulPod=true podCreationTimestamp="2026-07-28 12:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:11.99959171 +0000 UTC m=+320.609457437" watchObservedRunningTime="2026-07-28 12:35:12.001361443 +0000 UTC m=+320.611227153"
Jul 28 12:35:12.792172 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.792137    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"]
Jul 28 12:35:12.876688 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.876644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"]
Jul 28 12:35:12.876882 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.876786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:12.879031 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.879004    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 28 12:35:12.879172 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.879088    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 28 12:35:12.879534 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.879511    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8sz48\""
Jul 28 12:35:12.879701 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.879579    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 12:35:12.879701 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.879593    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 28 12:35:12.879701 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.879606    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8pjc5t4rs3ne9\""
Jul 28 12:35:12.901766 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.901722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-metrics-server-audit-profiles\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:12.901766 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.901757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:12.902001 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.901785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-secret-metrics-server-tls\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:12.902001 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.901825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-client-ca-bundle\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:12.902001 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.901854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nw49\" (UniqueName: \"kubernetes.io/projected/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-kube-api-access-9nw49\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:12.902001 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.901872    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-audit-log\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:12.902174 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:12.902038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-secret-metrics-server-client-certs\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.002534 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.002498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-secret-metrics-server-tls\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.002534 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.002540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-client-ca-bundle\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.003679 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.002579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nw49\" (UniqueName: \"kubernetes.io/projected/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-kube-api-access-9nw49\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.003679 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.002604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-audit-log\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.003679 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.002684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-secret-metrics-server-client-certs\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.003679 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.002736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-metrics-server-audit-profiles\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.003679 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.002764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.003679 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.003091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-audit-log\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.003679 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.003486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.004144 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.004122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-metrics-server-audit-profiles\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.005584 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.005555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-secret-metrics-server-tls\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.005737 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.005719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-secret-metrics-server-client-certs\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.005830 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.005811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-client-ca-bundle\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.010068 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.010045    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nw49\" (UniqueName: \"kubernetes.io/projected/41b478d2-e9a9-42ce-8c83-c8de1649e4c1-kube-api-access-9nw49\") pod \"metrics-server-7ddb6c5c65-hnk92\" (UID: \"41b478d2-e9a9-42ce-8c83-c8de1649e4c1\") " pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.188868 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.188778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:13.189886 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.189854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:13.279352 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.279320    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:13.347120 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.347084    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"]
Jul 28 12:35:13.365523 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.365490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:13.427219 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:35:13.427195    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b478d2_e9a9_42ce_8c83_c8de1649e4c1.slice/crio-c134992efacb1045f221651e53dcd5a70ea1c4fedc8ec30644a0303a258e3739 WatchSource:0}: Error finding container c134992efacb1045f221651e53dcd5a70ea1c4fedc8ec30644a0303a258e3739: Status 404 returned error can't find the container with id c134992efacb1045f221651e53dcd5a70ea1c4fedc8ec30644a0303a258e3739
Jul 28 12:35:13.991035 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.990974    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pl55j" event={"ID":"c06f0b0d-03a0-4f54-bd8b-31db467ce298","Type":"ContainerStarted","Data":"a34feff56927999c7b7bd4a7e1188958d56dd4f8a3bbd1ff5db75bce92436abf"}
Jul 28 12:35:13.992121 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:13.992094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92" event={"ID":"41b478d2-e9a9-42ce-8c83-c8de1649e4c1","Type":"ContainerStarted","Data":"c134992efacb1045f221651e53dcd5a70ea1c4fedc8ec30644a0303a258e3739"}
Jul 28 12:35:14.009598 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.009545    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pl55j" podStartSLOduration=33.641422462 podStartE2EDuration="58.009528814s" totalImagesPullingTime="24.368106352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:34:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:14.007967064 +0000 UTC m=+322.617832771" watchObservedRunningTime="2026-07-28 12:35:14.009528814 +0000 UTC m=+322.619394522"
Jul 28 12:35:14.608925 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.608879    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:14.613798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.613770    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 12:35:14.636452 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.634644    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.636452 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.635860    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 12:35:14.640942 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.640147    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 12:35:14.640942 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.640293    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 12:35:14.640942 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.640374    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 12:35:14.640942 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.640458    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 12:35:14.640942 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.640495    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-26gp4\""
Jul 28 12:35:14.640942 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.640546    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 12:35:14.640942 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.640837    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 12:35:14.641433 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.641206    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-21kkv1el7ii96\""
Jul 28 12:35:14.641433 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.641296    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 12:35:14.641433 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.641311    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 12:35:14.641433 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.641209    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 12:35:14.641633 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.641444    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 12:35:14.641633 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.641605    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 12:35:14.641633 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.641632    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 12:35:14.641858 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.641842    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 12:35:14.646513 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.646491    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 12:35:14.719531 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.719726 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.719726 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.719726 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.719726 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719695    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2cjq\" (UniqueName: \"kubernetes.io/projected/4f526e66-8392-4a2d-bb17-768199401633-kube-api-access-q2cjq\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.719952 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.719952 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.719952 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.719952 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.719952 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f526e66-8392-4a2d-bb17-768199401633-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.719952 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-config\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.720289 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.719968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.720289 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.720022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.720289 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.720058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.720289 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.720085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.720289 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.720124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.720289 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.720175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f526e66-8392-4a2d-bb17-768199401633-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.720289 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.720214    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.720289 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.720239    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.720289 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.720254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.821404 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.821365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2cjq\" (UniqueName: \"kubernetes.io/projected/4f526e66-8392-4a2d-bb17-768199401633-kube-api-access-q2cjq\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.821404 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.821417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.821674 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.821518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.821674 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.821547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.821674 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.821584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.821674 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.821610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f526e66-8392-4a2d-bb17-768199401633-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.821674 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.821638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-config\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f526e66-8392-4a2d-bb17-768199401633-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822860    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.822885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.823809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.823269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.826674 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.825542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.827742 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.827714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.828028 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.828005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.828428 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.828401    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.828639 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.828614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.828867 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.828839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-config\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.829062 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.829035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.829556 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.829530    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.829556 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.829545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.829703 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.829568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4f526e66-8392-4a2d-bb17-768199401633-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.830143 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.830083    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f526e66-8392-4a2d-bb17-768199401633-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.830337 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.830318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.830931 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.830910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.831948 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.831925    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.832271 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.832252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.833354 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.833303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f526e66-8392-4a2d-bb17-768199401633-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.833438 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.833403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f526e66-8392-4a2d-bb17-768199401633-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.835698 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.835657    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2cjq\" (UniqueName: \"kubernetes.io/projected/4f526e66-8392-4a2d-bb17-768199401633-kube-api-access-q2cjq\") pod \"prometheus-k8s-0\" (UID: \"4f526e66-8392-4a2d-bb17-768199401633\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:14.950561 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:14.950525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:15.172191 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:15.172145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:15.269670 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:15.269605    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 12:35:15.273167 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:35:15.273140    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f526e66_8392_4a2d_bb17_768199401633.slice/crio-917116a8ebe3e36a9cb06182e0b61fe1891e18199fe716baf4970abafd498fdb WatchSource:0}: Error finding container 917116a8ebe3e36a9cb06182e0b61fe1891e18199fe716baf4970abafd498fdb: Status 404 returned error can't find the container with id 917116a8ebe3e36a9cb06182e0b61fe1891e18199fe716baf4970abafd498fdb
Jul 28 12:35:15.273586 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:15.273555    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:16.001662 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:16.001624    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92" event={"ID":"41b478d2-e9a9-42ce-8c83-c8de1649e4c1","Type":"ContainerStarted","Data":"49dd48aff28e3306f4ebbb949cd64af47fd120e020a8d5e8314cafc02d29c757"}
Jul 28 12:35:16.002836 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:16.002812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f526e66-8392-4a2d-bb17-768199401633","Type":"ContainerStarted","Data":"917116a8ebe3e36a9cb06182e0b61fe1891e18199fe716baf4970abafd498fdb"}
Jul 28 12:35:16.018626 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:16.018586    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92" podStartSLOduration=1.901779906 podStartE2EDuration="4.018571327s" totalImagesPullingTime="2.116791421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:16.017255659 +0000 UTC m=+324.627121367" watchObservedRunningTime="2026-07-28 12:35:16.018571327 +0000 UTC m=+324.628437036"
Jul 28 12:35:17.720601 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:17.720562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:17.835906 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:17.835870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:18.018403 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:18.018369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f526e66-8392-4a2d-bb17-768199401633","Type":"ContainerStarted","Data":"0336928859de95d213ecf012e2ca49d43584235c2293088257e3dde906871111"}
Jul 28 12:35:19.024147 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:19.024114    2565 generic.go:356] "Generic (PLEG): container finished" podID="4f526e66-8392-4a2d-bb17-768199401633" containerID="0336928859de95d213ecf012e2ca49d43584235c2293088257e3dde906871111" exitCode=0
Jul 28 12:35:19.024634 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:19.024201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f526e66-8392-4a2d-bb17-768199401633","Type":"ContainerDied","Data":"0336928859de95d213ecf012e2ca49d43584235c2293088257e3dde906871111"}
Jul 28 12:35:23.041992 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:23.041946    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f526e66-8392-4a2d-bb17-768199401633","Type":"ContainerStarted","Data":"cc1b3fd0d9942c26ebe4977fe63f0e040e0a7ea0d317d000107bb4f1c36ab885"}
Jul 28 12:35:23.042369 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:23.042023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f526e66-8392-4a2d-bb17-768199401633","Type":"ContainerStarted","Data":"c62978ffbc49d644958b6d52084f2d93613489e128a3bf11515087ce7cf8d730"}
Jul 28 12:35:23.276487 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:23.276448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:24.294765 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:24.294727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:25.054065 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:25.054036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f526e66-8392-4a2d-bb17-768199401633","Type":"ContainerStarted","Data":"c0ea4fe43b2cf60c62c2a44cd584bf3d01eeb2138f0061482eaf1a6970c2aa5b"}
Jul 28 12:35:26.061343 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:26.061316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f526e66-8392-4a2d-bb17-768199401633","Type":"ContainerStarted","Data":"de73a1b6d58f023ac95d536dbbf12feb359c9452e12a3ca0b41e7190bc170471"}
Jul 28 12:35:26.061739 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:26.061374    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f526e66-8392-4a2d-bb17-768199401633","Type":"ContainerStarted","Data":"95b2428d63c1963dfd4a35ced5859d0d2bff24874a6cebdb3f6d1bdf302e2f83"}
Jul 28 12:35:26.061739 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:26.061409    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f526e66-8392-4a2d-bb17-768199401633","Type":"ContainerStarted","Data":"ccddfdf64c8a4af078486c1bfcca9f4ce53007b919a1480c8b8b5e900dc3d10f"}
Jul 28 12:35:26.088715 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:26.088668    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.820015241 podStartE2EDuration="12.088652971s" totalImagesPullingTime="8.246370333s" totalInitContainerRuntime="22.267397ms" isStatefulPod=false podCreationTimestamp="2026-07-28 12:35:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:35:26.087269135 +0000 UTC m=+334.697134842" watchObservedRunningTime="2026-07-28 12:35:26.088652971 +0000 UTC m=+334.698518678"
Jul 28 12:35:26.707344 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:26.707318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:26.780763 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:26.780733    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:29.560236 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.560199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:29.597094 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.597056    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr" podUID="f0b2325f-97cb-47d9-b60e-501fe53c3fab" containerName="registry" containerID="cri-o://d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794" gracePeriod=30
Jul 28 12:35:29.645091 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.645053    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:29.887852 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.887824    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:35:29.951070 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.951044    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:35:29.972823 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.972797    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr88g\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-kube-api-access-lr88g\") pod \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") "
Jul 28 12:35:29.972949 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.972839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-certificates\") pod \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") "
Jul 28 12:35:29.972949 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.972885    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-image-registry-private-configuration\") pod \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") "
Jul 28 12:35:29.972949 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.972909    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") pod \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") "
Jul 28 12:35:29.972949 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.972947    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0b2325f-97cb-47d9-b60e-501fe53c3fab-ca-trust-extracted\") pod \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") "
Jul 28 12:35:29.973189 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.973030    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-installation-pull-secrets\") pod \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") "
Jul 28 12:35:29.973189 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.973055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-bound-sa-token\") pod \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") "
Jul 28 12:35:29.973189 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.973110    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-trusted-ca\") pod \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\" (UID: \"f0b2325f-97cb-47d9-b60e-501fe53c3fab\") "
Jul 28 12:35:29.974259 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.974181    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f0b2325f-97cb-47d9-b60e-501fe53c3fab" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:35:29.974636 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.974601    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f0b2325f-97cb-47d9-b60e-501fe53c3fab" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:35:29.975770 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.975743    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f0b2325f-97cb-47d9-b60e-501fe53c3fab" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:35:29.975869 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.975826    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f0b2325f-97cb-47d9-b60e-501fe53c3fab" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:35:29.975938 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.975873    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f0b2325f-97cb-47d9-b60e-501fe53c3fab" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:35:29.975938 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.975917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f0b2325f-97cb-47d9-b60e-501fe53c3fab" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:35:29.976080 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.975961    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-kube-api-access-lr88g" (OuterVolumeSpecName: "kube-api-access-lr88g") pod "f0b2325f-97cb-47d9-b60e-501fe53c3fab" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab"). InnerVolumeSpecName "kube-api-access-lr88g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:35:29.981475 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:29.981454    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0b2325f-97cb-47d9-b60e-501fe53c3fab-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f0b2325f-97cb-47d9-b60e-501fe53c3fab" (UID: "f0b2325f-97cb-47d9-b60e-501fe53c3fab"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:35:30.074439 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.074407    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-image-registry-private-configuration\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:35:30.074652 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.074634    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-tls\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:35:30.074763 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.074749    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f0b2325f-97cb-47d9-b60e-501fe53c3fab-ca-trust-extracted\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:35:30.074828 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.074807    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f0b2325f-97cb-47d9-b60e-501fe53c3fab-installation-pull-secrets\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:35:30.074885 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.074825    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-bound-sa-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:35:30.074885 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.074839    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-trusted-ca\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:35:30.074885 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.074852    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr88g\" (UniqueName: \"kubernetes.io/projected/f0b2325f-97cb-47d9-b60e-501fe53c3fab-kube-api-access-lr88g\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:35:30.074885 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.074866    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f0b2325f-97cb-47d9-b60e-501fe53c3fab-registry-certificates\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:35:30.078173 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.078148    2565 generic.go:356] "Generic (PLEG): container finished" podID="f0b2325f-97cb-47d9-b60e-501fe53c3fab" containerID="d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794" exitCode=0
Jul 28 12:35:30.078270 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.078189    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"
Jul 28 12:35:30.078270 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.078225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr" event={"ID":"f0b2325f-97cb-47d9-b60e-501fe53c3fab","Type":"ContainerDied","Data":"d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794"}
Jul 28 12:35:30.078351 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.078272    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c9d6c6f45-gw7fr" event={"ID":"f0b2325f-97cb-47d9-b60e-501fe53c3fab","Type":"ContainerDied","Data":"e57dfac2fe2e50d30d840283100256c18e9f7b030cc573dde7496c41468fe61d"}
Jul 28 12:35:30.078351 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.078293    2565 scope.go:117] "RemoveContainer" containerID="d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794"
Jul 28 12:35:30.087473 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.087456    2565 scope.go:117] "RemoveContainer" containerID="d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794"
Jul 28 12:35:30.087716 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:35:30.087698    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794\": container with ID starting with d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794 not found: ID does not exist" containerID="d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794"
Jul 28 12:35:30.087764 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.087725    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794"} err="failed to get container status \"d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794\": rpc error: code = NotFound desc = could not find container \"d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794\": container with ID starting with d728e1946a1df341370a5e95106db9d8e56975ea09664af24db0a83d274e7794 not found: ID does not exist"
Jul 28 12:35:30.097266 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.097245    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"]
Jul 28 12:35:30.101087 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:30.101070    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c9d6c6f45-gw7fr"]
Jul 28 12:35:31.897927 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:31.897896    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0b2325f-97cb-47d9-b60e-501fe53c3fab" path="/var/lib/kubelet/pods/f0b2325f-97cb-47d9-b60e-501fe53c3fab/volumes"
Jul 28 12:35:33.189700 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:33.189670    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:33.190111 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:33.189724    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:37.106059 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:37.105993    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce291cde-2d3b-4c5f-8246-814881b8c891" containerID="945dc83b3670daa717f54c13a130815ac09c1bfe0a73aded5c7dc9e032dc9479" exitCode=0
Jul 28 12:35:37.106059 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:37.106049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-2vpn2" event={"ID":"ce291cde-2d3b-4c5f-8246-814881b8c891","Type":"ContainerDied","Data":"945dc83b3670daa717f54c13a130815ac09c1bfe0a73aded5c7dc9e032dc9479"}
Jul 28 12:35:37.106481 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:37.106389    2565 scope.go:117] "RemoveContainer" containerID="945dc83b3670daa717f54c13a130815ac09c1bfe0a73aded5c7dc9e032dc9479"
Jul 28 12:35:38.111692 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:38.111659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-2vpn2" event={"ID":"ce291cde-2d3b-4c5f-8246-814881b8c891","Type":"ContainerStarted","Data":"e5a9e49d328d822435c9026f3f56a2764b56b5216258e98f1c178a904249a4e0"}
Jul 28 12:35:38.263521 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:38.263486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:38.363435 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:38.363351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:35:43.134404 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:43.134285    2565 generic.go:356] "Generic (PLEG): container finished" podID="13271b45-4738-4235-bb1e-ddf00d89730b" containerID="bac7aa4dda1a780b5898851da3f2a2c67ff242d29669dad85a5cc81d0ea83d76" exitCode=0
Jul 28 12:35:43.134404 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:43.134351    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q" event={"ID":"13271b45-4738-4235-bb1e-ddf00d89730b","Type":"ContainerDied","Data":"bac7aa4dda1a780b5898851da3f2a2c67ff242d29669dad85a5cc81d0ea83d76"}
Jul 28 12:35:43.134862 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:43.134623    2565 scope.go:117] "RemoveContainer" containerID="bac7aa4dda1a780b5898851da3f2a2c67ff242d29669dad85a5cc81d0ea83d76"
Jul 28 12:35:44.139811 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:44.139779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-xtv6q" event={"ID":"13271b45-4738-4235-bb1e-ddf00d89730b","Type":"ContainerStarted","Data":"438dca8cd6fbb943f175c82952b61a849b5a03954ffc5983c72d91a57930d634"}
Jul 28 12:35:53.194947 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:53.194921    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:35:53.198697 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:35:53.198679    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7ddb6c5c65-hnk92"
Jul 28 12:36:05.792927 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:05.792892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:36:05.795345 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:05.795325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ead778-8308-459e-9361-5091cc6b8849-metrics-certs\") pod \"network-metrics-daemon-l9cdv\" (UID: \"00ead778-8308-459e-9361-5091cc6b8849\") " pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:36:05.896709 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:05.896673    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nm4t9\""
Jul 28 12:36:05.905167 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:05.905141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9cdv"
Jul 28 12:36:06.044971 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:06.044947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l9cdv"]
Jul 28 12:36:06.047205 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:36:06.047179    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ead778_8308_459e_9361_5091cc6b8849.slice/crio-080e5894b554520872367a8a3e31ac026954702e44642c5ca3d0f2f7b86276b3 WatchSource:0}: Error finding container 080e5894b554520872367a8a3e31ac026954702e44642c5ca3d0f2f7b86276b3: Status 404 returned error can't find the container with id 080e5894b554520872367a8a3e31ac026954702e44642c5ca3d0f2f7b86276b3
Jul 28 12:36:06.227798 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:06.227764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9cdv" event={"ID":"00ead778-8308-459e-9361-5091cc6b8849","Type":"ContainerStarted","Data":"080e5894b554520872367a8a3e31ac026954702e44642c5ca3d0f2f7b86276b3"}
Jul 28 12:36:07.233489 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:07.233459    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9cdv" event={"ID":"00ead778-8308-459e-9361-5091cc6b8849","Type":"ContainerStarted","Data":"d3e1765b58b63f068ec1a2d94ec44b8457ffef989fd50d0d8b3ca03295bd5768"}
Jul 28 12:36:07.233972 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:07.233521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9cdv" event={"ID":"00ead778-8308-459e-9361-5091cc6b8849","Type":"ContainerStarted","Data":"5491c575676b3f0dda70d39c7dc1e1c6d73e57261c5b8dd5be1ddf4fc71f9f06"}
Jul 28 12:36:07.262300 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:07.262246    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l9cdv" podStartSLOduration=374.500021043 podStartE2EDuration="6m15.262228057s" totalImagesPullingTime="762.207014ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:36:07.261378778 +0000 UTC m=+375.871244489" watchObservedRunningTime="2026-07-28 12:36:07.262228057 +0000 UTC m=+375.872093765"
Jul 28 12:36:07.363328 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:07.363292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:07.427103 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:07.427069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:14.951169 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:14.951128    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:36:14.967454 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:14.967432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:36:15.283148 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:15.283058    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 12:36:24.484679 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:24.484645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:24.544081 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:24.544050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:25.021514 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:25.021477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:25.085397 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:25.085349    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:30.748732 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:30.748697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:30.849660 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:30.849603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:36.457267 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:36.457227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:36.511331 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:36.511295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:37.902793 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:37.902736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:38.022573 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:38.022539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:48.878904 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:48.878854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:48.980028 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:48.979995    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:49.036168 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:49.036130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:53.304345 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:53.304300    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:53.402807 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:53.402744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:36:57.866872 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:36:57.866786    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:37:33.961777 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:37:33.961731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:37:34.061772 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:37:34.061730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:37:57.428508 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:37:57.428470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:38:03.873164 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:38:03.873112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:38:45.485552 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:38:45.485455    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:38:45.583878 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:38:45.583848    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:12.296558 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:12.296515    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:13.093835 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:13.093796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:15.919830 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:15.919795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:16.009275 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:16.009243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:17.363919 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:17.363884    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:17.466152 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:17.466121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:19.773180 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:19.773138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:20.189789 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:20.189689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:20.514520 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:20.514480    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:20.619214 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:20.619165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:20.727372 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:20.727333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:20.787316 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:20.787231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:27.107722 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:27.107689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:27.163527 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:27.163494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:27.981316 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:27.981283    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:34.574531 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:34.574494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:34.674996 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:34.674942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:40.422189 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:40.422158    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:40.523587 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:40.523543    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:42.136693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:42.136659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:51.887785 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:51.887748    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:56.530458 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.530424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:56.630258 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.630227    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"]
Jul 28 12:39:56.630518 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.630507    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b2325f-97cb-47d9-b60e-501fe53c3fab" containerName="registry"
Jul 28 12:39:56.630560 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.630520    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b2325f-97cb-47d9-b60e-501fe53c3fab" containerName="registry"
Jul 28 12:39:56.630597 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.630590    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0b2325f-97cb-47d9-b60e-501fe53c3fab" containerName="registry"
Jul 28 12:39:56.632758 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.632743    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.636795 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.636772    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 12:39:56.638056 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.638030    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zw8p2\""
Jul 28 12:39:56.638056 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.638044    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:39:56.638056 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.638052    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 12:39:56.638291 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.638054    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 12:39:56.638291 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.638049    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 12:39:56.650707 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.650678    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"]
Jul 28 12:39:56.678917 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.678884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/144ec6c9-2f78-4e91-920d-b63b1d04076b-manager-config\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.679050 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.678920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/144ec6c9-2f78-4e91-920d-b63b1d04076b-metrics-cert\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.679050 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.678943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sfcf\" (UniqueName: \"kubernetes.io/projected/144ec6c9-2f78-4e91-920d-b63b1d04076b-kube-api-access-6sfcf\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.679050 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.678969    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/144ec6c9-2f78-4e91-920d-b63b1d04076b-cert\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.690859 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.690833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:56.780252 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.780219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/144ec6c9-2f78-4e91-920d-b63b1d04076b-manager-config\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.780457 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.780263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/144ec6c9-2f78-4e91-920d-b63b1d04076b-metrics-cert\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.780457 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.780293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sfcf\" (UniqueName: \"kubernetes.io/projected/144ec6c9-2f78-4e91-920d-b63b1d04076b-kube-api-access-6sfcf\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.780457 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.780309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/144ec6c9-2f78-4e91-920d-b63b1d04076b-cert\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.780896 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.780839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/144ec6c9-2f78-4e91-920d-b63b1d04076b-manager-config\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.782809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.782787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/144ec6c9-2f78-4e91-920d-b63b1d04076b-metrics-cert\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.782895 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.782844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/144ec6c9-2f78-4e91-920d-b63b1d04076b-cert\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.788776 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.788755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sfcf\" (UniqueName: \"kubernetes.io/projected/144ec6c9-2f78-4e91-920d-b63b1d04076b-kube-api-access-6sfcf\") pod \"lws-controller-manager-746578bc67-jsj2w\" (UID: \"144ec6c9-2f78-4e91-920d-b63b1d04076b\") " pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:56.943145 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:56.943115    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:39:57.079703 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:57.079674    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"]
Jul 28 12:39:57.081316 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:39:57.081288    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144ec6c9_2f78_4e91_920d_b63b1d04076b.slice/crio-ef8c73e07a7e79e3aada9a7629d5ad84e5643fa3d5dc9dc6e275f3b3586ad931 WatchSource:0}: Error finding container ef8c73e07a7e79e3aada9a7629d5ad84e5643fa3d5dc9dc6e275f3b3586ad931: Status 404 returned error can't find the container with id ef8c73e07a7e79e3aada9a7629d5ad84e5643fa3d5dc9dc6e275f3b3586ad931
Jul 28 12:39:57.110778 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:57.110740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w" event={"ID":"144ec6c9-2f78-4e91-920d-b63b1d04076b","Type":"ContainerStarted","Data":"ef8c73e07a7e79e3aada9a7629d5ad84e5643fa3d5dc9dc6e275f3b3586ad931"}
Jul 28 12:39:58.426745 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:58.426689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:39:59.401903 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.401861    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"]
Jul 28 12:39:59.406071 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.406049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.409444 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.409414    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 12:39:59.409567 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.409464    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 12:39:59.409791 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.409766    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 12:39:59.409791 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.409788    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fv4tk\""
Jul 28 12:39:59.409963 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.409843    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 12:39:59.426908 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.426884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"]
Jul 28 12:39:59.504925 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.504888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6c9a01c-8005-4863-b481-5266f246fd7f-tmp\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.505136 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.504942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b6c9a01c-8005-4863-b481-5266f246fd7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.505136 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.505022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9wgw\" (UniqueName: \"kubernetes.io/projected/b6c9a01c-8005-4863-b481-5266f246fd7f-kube-api-access-t9wgw\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.505136 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.505067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b6c9a01c-8005-4863-b481-5266f246fd7f-manifests\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.505136 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.505095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6c9a01c-8005-4863-b481-5266f246fd7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.606092 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.606061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6c9a01c-8005-4863-b481-5266f246fd7f-tmp\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.606267 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.606102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b6c9a01c-8005-4863-b481-5266f246fd7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.606267 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.606131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9wgw\" (UniqueName: \"kubernetes.io/projected/b6c9a01c-8005-4863-b481-5266f246fd7f-kube-api-access-t9wgw\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.606267 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.606250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b6c9a01c-8005-4863-b481-5266f246fd7f-manifests\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.606432 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.606292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6c9a01c-8005-4863-b481-5266f246fd7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.606626 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.606607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b6c9a01c-8005-4863-b481-5266f246fd7f-manifests\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.608518 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.608495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6c9a01c-8005-4863-b481-5266f246fd7f-tmp\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.608643 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.608568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b6c9a01c-8005-4863-b481-5266f246fd7f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.608747 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.608727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b6c9a01c-8005-4863-b481-5266f246fd7f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.614967 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.614943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9wgw\" (UniqueName: \"kubernetes.io/projected/b6c9a01c-8005-4863-b481-5266f246fd7f-kube-api-access-t9wgw\") pod \"opendatahub-operator-controller-manager-7974886bdb-rmcj9\" (UID: \"b6c9a01c-8005-4863-b481-5266f246fd7f\") " pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.719302 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.719282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:39:59.888089 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.888053    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"]
Jul 28 12:39:59.891614 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:39:59.891587    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c9a01c_8005_4863_b481_5266f246fd7f.slice/crio-a7479177e487c7e47d6b640f1e1f3fbec744ed165e2ce8cfbfb933726c2563e5 WatchSource:0}: Error finding container a7479177e487c7e47d6b640f1e1f3fbec744ed165e2ce8cfbfb933726c2563e5: Status 404 returned error can't find the container with id a7479177e487c7e47d6b640f1e1f3fbec744ed165e2ce8cfbfb933726c2563e5
Jul 28 12:39:59.963006 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:39:59.962955    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:00.063382 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:00.063353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:00.129965 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:00.129921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w" event={"ID":"144ec6c9-2f78-4e91-920d-b63b1d04076b","Type":"ContainerStarted","Data":"de15b104b295ad39fcaef34830fa74237baa3c8b4ce1163144233c6c1625c236"}
Jul 28 12:40:00.130169 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:00.130043    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:40:00.131219 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:00.131200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9" event={"ID":"b6c9a01c-8005-4863-b481-5266f246fd7f","Type":"ContainerStarted","Data":"a7479177e487c7e47d6b640f1e1f3fbec744ed165e2ce8cfbfb933726c2563e5"}
Jul 28 12:40:00.146522 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:00.146476    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w" podStartSLOduration=1.578666651 podStartE2EDuration="4.146460474s" totalImagesPullingTime="2.567793823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:40:00.14449012 +0000 UTC m=+608.754355840" watchObservedRunningTime="2026-07-28 12:40:00.146460474 +0000 UTC m=+608.756326183"
Jul 28 12:40:00.150602 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:00.150578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:01.401715 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:01.401687    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:40:01.404002 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:01.403959    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:40:04.150174 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:04.150142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9" event={"ID":"b6c9a01c-8005-4863-b481-5266f246fd7f","Type":"ContainerStarted","Data":"a5d31deabf93ef1c1a09e05596498a0e3505e04b97b319df8ff1983466c6bc5b"}
Jul 28 12:40:05.155640 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:05.155603    2565 generic.go:356] "Generic (PLEG): container finished" podID="b6c9a01c-8005-4863-b481-5266f246fd7f" containerID="a5d31deabf93ef1c1a09e05596498a0e3505e04b97b319df8ff1983466c6bc5b" exitCode=0
Jul 28 12:40:05.156045 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:05.155669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9" event={"ID":"b6c9a01c-8005-4863-b481-5266f246fd7f","Type":"ContainerDied","Data":"a5d31deabf93ef1c1a09e05596498a0e3505e04b97b319df8ff1983466c6bc5b"}
Jul 28 12:40:05.156239 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:05.156224    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 12:40:06.161320 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:06.161280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9" event={"ID":"b6c9a01c-8005-4863-b481-5266f246fd7f","Type":"ContainerStarted","Data":"0b89c6aad6c624160f23e583d6ae660d5912cd9878f9055b9a862ba1e8d1bee9"}
Jul 28 12:40:06.161731 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:06.161368    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:40:06.183186 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:06.183133    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9" podStartSLOduration=2.61635246 podStartE2EDuration="7.183112714s" totalImagesPullingTime="3.547647363s" totalInitContainerRuntime="1.019112891s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:39:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:40:06.1823856 +0000 UTC m=+614.792251327" watchObservedRunningTime="2026-07-28 12:40:06.183112714 +0000 UTC m=+614.792978423"
Jul 28 12:40:10.067811 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:10.067777    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:11.138915 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:11.138879    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-746578bc67-jsj2w"
Jul 28 12:40:11.344113 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:11.344075    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:11.445495 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:11.445463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:14.913698 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:14.913608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:15.014659 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:15.014624    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:15.384386 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:15.384355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:15.489706 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:15.489669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:17.168292 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:17.168267    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7974886bdb-rmcj9"
Jul 28 12:40:18.892618 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:18.892589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:19.027572 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.027535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:19.287807 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.287770    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:19.435172 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.435146    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b958f484-zlwkm"]
Jul 28 12:40:19.447560 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.447527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:19.503397 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.503371    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b958f484-zlwkm"]
Jul 28 12:40:19.503563 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.503465    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.506016 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.505963    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 12:40:19.506424 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.506408    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9btbb\""
Jul 28 12:40:19.506424 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.506416    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 12:40:19.688399 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.688322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1c28984-3d42-4204-b47d-1b594597704a-tls-certs\") pod \"kube-auth-proxy-b958f484-zlwkm\" (UID: \"f1c28984-3d42-4204-b47d-1b594597704a\") " pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.688399 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.688355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnvcn\" (UniqueName: \"kubernetes.io/projected/f1c28984-3d42-4204-b47d-1b594597704a-kube-api-access-jnvcn\") pod \"kube-auth-proxy-b958f484-zlwkm\" (UID: \"f1c28984-3d42-4204-b47d-1b594597704a\") " pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.688399 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.688380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1c28984-3d42-4204-b47d-1b594597704a-tmp\") pod \"kube-auth-proxy-b958f484-zlwkm\" (UID: \"f1c28984-3d42-4204-b47d-1b594597704a\") " pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.769856 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.769822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:19.789665 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.789641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1c28984-3d42-4204-b47d-1b594597704a-tls-certs\") pod \"kube-auth-proxy-b958f484-zlwkm\" (UID: \"f1c28984-3d42-4204-b47d-1b594597704a\") " pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.789836 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.789671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnvcn\" (UniqueName: \"kubernetes.io/projected/f1c28984-3d42-4204-b47d-1b594597704a-kube-api-access-jnvcn\") pod \"kube-auth-proxy-b958f484-zlwkm\" (UID: \"f1c28984-3d42-4204-b47d-1b594597704a\") " pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.789836 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.789704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1c28984-3d42-4204-b47d-1b594597704a-tmp\") pod \"kube-auth-proxy-b958f484-zlwkm\" (UID: \"f1c28984-3d42-4204-b47d-1b594597704a\") " pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.792092 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.792066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1c28984-3d42-4204-b47d-1b594597704a-tmp\") pod \"kube-auth-proxy-b958f484-zlwkm\" (UID: \"f1c28984-3d42-4204-b47d-1b594597704a\") " pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.792298 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.792280    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1c28984-3d42-4204-b47d-1b594597704a-tls-certs\") pod \"kube-auth-proxy-b958f484-zlwkm\" (UID: \"f1c28984-3d42-4204-b47d-1b594597704a\") " pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.798266 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.798244    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnvcn\" (UniqueName: \"kubernetes.io/projected/f1c28984-3d42-4204-b47d-1b594597704a-kube-api-access-jnvcn\") pod \"kube-auth-proxy-b958f484-zlwkm\" (UID: \"f1c28984-3d42-4204-b47d-1b594597704a\") " pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.813110 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.813092    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm"
Jul 28 12:40:19.864819 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.864781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:19.965859 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.965824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:19.985867 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:19.985843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b958f484-zlwkm"]
Jul 28 12:40:19.987965 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:40:19.987939    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c28984_3d42_4204_b47d_1b594597704a.slice/crio-5a146c55009ff0a6f54421596323f3ff3d150957f3494afa44d48b39c656d25a WatchSource:0}: Error finding container 5a146c55009ff0a6f54421596323f3ff3d150957f3494afa44d48b39c656d25a: Status 404 returned error can't find the container with id 5a146c55009ff0a6f54421596323f3ff3d150957f3494afa44d48b39c656d25a
Jul 28 12:40:20.227081 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:20.226958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm" event={"ID":"f1c28984-3d42-4204-b47d-1b594597704a","Type":"ContainerStarted","Data":"5a146c55009ff0a6f54421596323f3ff3d150957f3494afa44d48b39c656d25a"}
Jul 28 12:40:20.245450 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:20.245418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:20.382492 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:20.382461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:20.477631 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:20.477559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:20.614193 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:20.614078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:20.867176 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:20.867064    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:20.923053 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:20.923013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:21.151451 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:21.151364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:21.877558 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:21.877524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:24.247132 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:24.247095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm" event={"ID":"f1c28984-3d42-4204-b47d-1b594597704a","Type":"ContainerStarted","Data":"53ec14befe09e24bfccfd07237578400cca87f2acbd613eab32a182d52dae760"}
Jul 28 12:40:24.262861 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:24.262814    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b958f484-zlwkm" podStartSLOduration=1.571785576 podStartE2EDuration="5.262798922s" totalImagesPullingTime="3.691013346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:40:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:40:24.262624013 +0000 UTC m=+632.872489722" watchObservedRunningTime="2026-07-28 12:40:24.262798922 +0000 UTC m=+632.872664629"
Jul 28 12:40:26.624365 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:26.624307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:26.730030 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:26.729974    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:27.466927 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:27.466893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:27.735999 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:27.735891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:28.139304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:28.139213    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:29.705935 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:29.705891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:29.809015 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:29.808960    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:29.963486 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:29.963405    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:30.298033 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:30.297911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:30.955529 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:30.955492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:31.062111 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:31.062072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:31.156026 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:31.155950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:33.983845 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:33.983809    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:34.085165 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:34.085127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:47.130711 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:47.130678    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:40:47.192766 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:40:47.192732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:20.481814 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:20.481778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:20.601678 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:20.601633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:20.701736 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:20.701697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:21.432499 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:21.432466    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:21.757782 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:21.757744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:49.806907 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:49.806832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:53.201514 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:53.201478    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:54.058219 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:54.058172    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:57.253433 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:57.253403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:57.630932 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:57.630820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:59.232304 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:59.232273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:41:59.870652 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:59.870622    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql"]
Jul 28 12:41:59.873788 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:59.873773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql"
Jul 28 12:41:59.877573 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:59.877528    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 28 12:41:59.877784 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:59.877763    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pqd9j\""
Jul 28 12:41:59.878115 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:59.878101    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 12:41:59.878178 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:59.878117    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 12:41:59.907247 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:59.907218    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql"]
Jul 28 12:41:59.946784 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:41:59.946754    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpth2\" (UniqueName: \"kubernetes.io/projected/2bd04226-dae0-417c-95d7-6fba0c7245c5-kube-api-access-dpth2\") pod \"dns-operator-controller-manager-864dd78c4c-5mkql\" (UID: \"2bd04226-dae0-417c-95d7-6fba0c7245c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql"
Jul 28 12:42:00.047922 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:00.047887    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpth2\" (UniqueName: \"kubernetes.io/projected/2bd04226-dae0-417c-95d7-6fba0c7245c5-kube-api-access-dpth2\") pod \"dns-operator-controller-manager-864dd78c4c-5mkql\" (UID: \"2bd04226-dae0-417c-95d7-6fba0c7245c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql"
Jul 28 12:42:00.061663 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:00.061630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpth2\" (UniqueName: \"kubernetes.io/projected/2bd04226-dae0-417c-95d7-6fba0c7245c5-kube-api-access-dpth2\") pod \"dns-operator-controller-manager-864dd78c4c-5mkql\" (UID: \"2bd04226-dae0-417c-95d7-6fba0c7245c5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql"
Jul 28 12:42:00.184332 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:00.184249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql"
Jul 28 12:42:00.318726 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:00.318696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql"]
Jul 28 12:42:00.321308 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:42:00.321284    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd04226_dae0_417c_95d7_6fba0c7245c5.slice/crio-fc6574a87ea225dd9b11ace99fa0534f7737c67c1f8eb1426ddfd7ef38175cbb WatchSource:0}: Error finding container fc6574a87ea225dd9b11ace99fa0534f7737c67c1f8eb1426ddfd7ef38175cbb: Status 404 returned error can't find the container with id fc6574a87ea225dd9b11ace99fa0534f7737c67c1f8eb1426ddfd7ef38175cbb
Jul 28 12:42:00.419066 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:00.419028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:00.514458 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:00.514416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:00.657175 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:00.657144    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql" event={"ID":"2bd04226-dae0-417c-95d7-6fba0c7245c5","Type":"ContainerStarted","Data":"fc6574a87ea225dd9b11ace99fa0534f7737c67c1f8eb1426ddfd7ef38175cbb"}
Jul 28 12:42:02.405804 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:02.405762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:02.669269 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:02.669181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql" event={"ID":"2bd04226-dae0-417c-95d7-6fba0c7245c5","Type":"ContainerStarted","Data":"f57975a2cec4c91eed0a47dcf44986e460a9018198b51f70ec4ad30a9a2cae14"}
Jul 28 12:42:02.669430 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:02.669314    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql"
Jul 28 12:42:02.692688 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:02.692642    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql" podStartSLOduration=1.551837846 podStartE2EDuration="3.692627616s" totalImagesPullingTime="2.14078977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:42:02.690708453 +0000 UTC m=+731.300574162" watchObservedRunningTime="2026-07-28 12:42:02.692627616 +0000 UTC m=+731.302493323"
Jul 28 12:42:03.016390 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:03.016350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:03.116450 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:03.116420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:05.416881 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:05.416846    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:05.517247 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:05.517210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:10.905245 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:10.905212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:11.001375 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:11.001338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:11.210720 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:11.210680    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:11.310670 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:11.310638    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:12.097475 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.097441    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"]
Jul 28 12:42:12.100936 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.100917    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:12.102707 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.102683    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 28 12:42:12.102851 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.102757    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tffwh\""
Jul 28 12:42:12.103048 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.103031    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 28 12:42:12.107633 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.107608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:12.107879 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.107859    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"]
Jul 28 12:42:12.150773 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.150745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a922736c-5875-49f4-985d-b5e71f6f4bef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ljswh\" (UID: \"a922736c-5875-49f4-985d-b5e71f6f4bef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:12.150936 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.150786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a922736c-5875-49f4-985d-b5e71f6f4bef-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ljswh\" (UID: \"a922736c-5875-49f4-985d-b5e71f6f4bef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:12.150936 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.150857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9m5b\" (UniqueName: \"kubernetes.io/projected/a922736c-5875-49f4-985d-b5e71f6f4bef-kube-api-access-z9m5b\") pod \"kuadrant-console-plugin-66b5774985-ljswh\" (UID: \"a922736c-5875-49f4-985d-b5e71f6f4bef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:12.252294 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.252267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9m5b\" (UniqueName: \"kubernetes.io/projected/a922736c-5875-49f4-985d-b5e71f6f4bef-kube-api-access-z9m5b\") pod \"kuadrant-console-plugin-66b5774985-ljswh\" (UID: \"a922736c-5875-49f4-985d-b5e71f6f4bef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:12.252455 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.252318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a922736c-5875-49f4-985d-b5e71f6f4bef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ljswh\" (UID: \"a922736c-5875-49f4-985d-b5e71f6f4bef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:12.252455 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.252358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a922736c-5875-49f4-985d-b5e71f6f4bef-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ljswh\" (UID: \"a922736c-5875-49f4-985d-b5e71f6f4bef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:12.252571 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:42:12.252486    2565 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 28 12:42:12.252571 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:42:12.252552    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a922736c-5875-49f4-985d-b5e71f6f4bef-plugin-serving-cert podName:a922736c-5875-49f4-985d-b5e71f6f4bef nodeName:}" failed. No retries permitted until 2026-07-28 12:42:12.752532609 +0000 UTC m=+741.362398295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/a922736c-5875-49f4-985d-b5e71f6f4bef-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-ljswh" (UID: "a922736c-5875-49f4-985d-b5e71f6f4bef") : secret "plugin-serving-cert" not found
Jul 28 12:42:12.253074 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.253057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a922736c-5875-49f4-985d-b5e71f6f4bef-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ljswh\" (UID: \"a922736c-5875-49f4-985d-b5e71f6f4bef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:12.260315 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.260294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9m5b\" (UniqueName: \"kubernetes.io/projected/a922736c-5875-49f4-985d-b5e71f6f4bef-kube-api-access-z9m5b\") pod \"kuadrant-console-plugin-66b5774985-ljswh\" (UID: \"a922736c-5875-49f4-985d-b5e71f6f4bef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:12.383274 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.383180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:12.756143 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.756102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a922736c-5875-49f4-985d-b5e71f6f4bef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ljswh\" (UID: \"a922736c-5875-49f4-985d-b5e71f6f4bef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:12.758610 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:12.758589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a922736c-5875-49f4-985d-b5e71f6f4bef-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ljswh\" (UID: \"a922736c-5875-49f4-985d-b5e71f6f4bef\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:13.021187 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:13.021120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"
Jul 28 12:42:13.155180 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:13.155148    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh"]
Jul 28 12:42:13.158115 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:42:13.158088    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda922736c_5875_49f4_985d_b5e71f6f4bef.slice/crio-6599e5d642e4b822d7f4ab5e5e8f149624761eb128ce7c1d82485cec9317a2b4 WatchSource:0}: Error finding container 6599e5d642e4b822d7f4ab5e5e8f149624761eb128ce7c1d82485cec9317a2b4: Status 404 returned error can't find the container with id 6599e5d642e4b822d7f4ab5e5e8f149624761eb128ce7c1d82485cec9317a2b4
Jul 28 12:42:13.674603 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:13.674575    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5mkql"
Jul 28 12:42:13.718707 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:13.718675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh" event={"ID":"a922736c-5875-49f4-985d-b5e71f6f4bef","Type":"ContainerStarted","Data":"6599e5d642e4b822d7f4ab5e5e8f149624761eb128ce7c1d82485cec9317a2b4"}
Jul 28 12:42:14.239694 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:14.239660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:14.336203 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:14.336167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:18.381171 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:18.381132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:18.479098 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:18.479059    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:25.099251 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:25.099213    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:25.208326 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:25.208252    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:28.941690 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:28.941636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:29.001953 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:29.001895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:29.093154 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:29.093112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:29.152864 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:29.152827    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:30.187361 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:30.187325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:32.886903 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:32.886865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:32.987691 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:32.987648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:36.842615 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:36.842576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh" event={"ID":"a922736c-5875-49f4-985d-b5e71f6f4bef","Type":"ContainerStarted","Data":"ab1a137332db03ffead5fc2621897848188ffa43b6676af16f573783e2068858"}
Jul 28 12:42:36.860621 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:36.860569    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljswh" podStartSLOduration=1.9125734460000001 podStartE2EDuration="24.86055504s" totalImagesPullingTime="22.947981594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:42:36.859997823 +0000 UTC m=+765.469863524" watchObservedRunningTime="2026-07-28 12:42:36.86055504 +0000 UTC m=+765.470420750"
Jul 28 12:42:37.657188 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:37.657154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:38.294557 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:38.294520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:38.349030 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:38.348964    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:39.537029 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.536996    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"]
Jul 28 12:42:39.576523 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.576493    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"]
Jul 28 12:42:39.576714 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.576624    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:42:39.578775 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.578753    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5k6kz\""
Jul 28 12:42:39.705393 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.705341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfac5e5a-1e08-4b29-9544-a10cfec294e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s4w4l\" (UID: \"bfac5e5a-1e08-4b29-9544-a10cfec294e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:42:39.705393 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.705398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2twv\" (UniqueName: \"kubernetes.io/projected/bfac5e5a-1e08-4b29-9544-a10cfec294e6-kube-api-access-r2twv\") pod \"kuadrant-operator-controller-manager-86878c769f-s4w4l\" (UID: \"bfac5e5a-1e08-4b29-9544-a10cfec294e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:42:39.806220 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.806129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfac5e5a-1e08-4b29-9544-a10cfec294e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s4w4l\" (UID: \"bfac5e5a-1e08-4b29-9544-a10cfec294e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:42:39.806220 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.806169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2twv\" (UniqueName: \"kubernetes.io/projected/bfac5e5a-1e08-4b29-9544-a10cfec294e6-kube-api-access-r2twv\") pod \"kuadrant-operator-controller-manager-86878c769f-s4w4l\" (UID: \"bfac5e5a-1e08-4b29-9544-a10cfec294e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:42:39.806605 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.806586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfac5e5a-1e08-4b29-9544-a10cfec294e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-s4w4l\" (UID: \"bfac5e5a-1e08-4b29-9544-a10cfec294e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:42:39.814690 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.814664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2twv\" (UniqueName: \"kubernetes.io/projected/bfac5e5a-1e08-4b29-9544-a10cfec294e6-kube-api-access-r2twv\") pod \"kuadrant-operator-controller-manager-86878c769f-s4w4l\" (UID: \"bfac5e5a-1e08-4b29-9544-a10cfec294e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:42:39.887437 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:39.887395    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:42:40.186446 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:40.186418    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"]
Jul 28 12:42:40.190461 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:42:40.190437    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfac5e5a_1e08_4b29_9544_a10cfec294e6.slice/crio-a23322fca0e0350835b16d39bcf12bf1424eba59544c805f66e6555ff288a8ca WatchSource:0}: Error finding container a23322fca0e0350835b16d39bcf12bf1424eba59544c805f66e6555ff288a8ca: Status 404 returned error can't find the container with id a23322fca0e0350835b16d39bcf12bf1424eba59544c805f66e6555ff288a8ca
Jul 28 12:42:40.862643 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:40.862608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l" event={"ID":"bfac5e5a-1e08-4b29-9544-a10cfec294e6","Type":"ContainerStarted","Data":"a23322fca0e0350835b16d39bcf12bf1424eba59544c805f66e6555ff288a8ca"}
Jul 28 12:42:45.890344 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:45.890308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l" event={"ID":"bfac5e5a-1e08-4b29-9544-a10cfec294e6","Type":"ContainerStarted","Data":"5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010"}
Jul 28 12:42:45.890818 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:45.890459    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:42:45.908271 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:45.908223    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l" podStartSLOduration=2.159593883 podStartE2EDuration="6.908207484s" totalImagesPullingTime="4.748613601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:42:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:42:45.906523744 +0000 UTC m=+774.516389467" watchObservedRunningTime="2026-07-28 12:42:45.908207484 +0000 UTC m=+774.518073192"
Jul 28 12:42:48.032732 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:48.032699    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:48.106971 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:48.106934    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:55.853810 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:55.853771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:55.962239 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:55.962196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:42:56.897482 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:42:56.897455    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:43:14.042376 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:14.042271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:14.150232 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:14.150174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:14.211140 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:14.211096    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:14.862999 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:14.862940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:14.939192 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:14.939156    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2x45h"]
Jul 28 12:43:14.941827 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:14.941794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:15.012155 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:15.012124    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2x45h"]
Jul 28 12:43:15.012310 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:15.012222    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2x45h"
Jul 28 12:43:15.014365 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:15.014342    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wf4f5\""
Jul 28 12:43:15.123016 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:15.122911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86gq9\" (UniqueName: \"kubernetes.io/projected/124b4672-a77f-4d4e-87b1-0785d06153e9-kube-api-access-86gq9\") pod \"authorino-75d556bd77-2x45h\" (UID: \"124b4672-a77f-4d4e-87b1-0785d06153e9\") " pod="kuadrant-system/authorino-75d556bd77-2x45h"
Jul 28 12:43:15.223672 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:15.223640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86gq9\" (UniqueName: \"kubernetes.io/projected/124b4672-a77f-4d4e-87b1-0785d06153e9-kube-api-access-86gq9\") pod \"authorino-75d556bd77-2x45h\" (UID: \"124b4672-a77f-4d4e-87b1-0785d06153e9\") " pod="kuadrant-system/authorino-75d556bd77-2x45h"
Jul 28 12:43:15.231082 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:15.231056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86gq9\" (UniqueName: \"kubernetes.io/projected/124b4672-a77f-4d4e-87b1-0785d06153e9-kube-api-access-86gq9\") pod \"authorino-75d556bd77-2x45h\" (UID: \"124b4672-a77f-4d4e-87b1-0785d06153e9\") " pod="kuadrant-system/authorino-75d556bd77-2x45h"
Jul 28 12:43:15.321580 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:15.321544    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2x45h"
Jul 28 12:43:15.471707 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:15.471677    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2x45h"]
Jul 28 12:43:15.476436 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:43:15.476405    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod124b4672_a77f_4d4e_87b1_0785d06153e9.slice/crio-823c71affd394dcb387a97ffd998366d80192e043a1f3df87eb85edd190709bb WatchSource:0}: Error finding container 823c71affd394dcb387a97ffd998366d80192e043a1f3df87eb85edd190709bb: Status 404 returned error can't find the container with id 823c71affd394dcb387a97ffd998366d80192e043a1f3df87eb85edd190709bb
Jul 28 12:43:16.037476 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:16.037445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2x45h" event={"ID":"124b4672-a77f-4d4e-87b1-0785d06153e9","Type":"ContainerStarted","Data":"823c71affd394dcb387a97ffd998366d80192e043a1f3df87eb85edd190709bb"}
Jul 28 12:43:19.055184 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:19.055148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2x45h" event={"ID":"124b4672-a77f-4d4e-87b1-0785d06153e9","Type":"ContainerStarted","Data":"b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8"}
Jul 28 12:43:19.069022 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:19.068954    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2x45h" podStartSLOduration=1.963610544 podStartE2EDuration="5.06893748s" totalImagesPullingTime="3.105326936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:43:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:43:19.068921667 +0000 UTC m=+807.678787375" watchObservedRunningTime="2026-07-28 12:43:19.06893748 +0000 UTC m=+807.678803188"
Jul 28 12:43:34.557306 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:34.557232    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:34.655202 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:34.655164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:35.107084 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:35.107049    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:47.221502 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:47.221463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:47.320910 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:47.320874    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:49.871534 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:49.871501    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2x45h"]
Jul 28 12:43:49.871937 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:49.871694    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2x45h" podUID="124b4672-a77f-4d4e-87b1-0785d06153e9" containerName="authorino" containerID="cri-o://b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8" gracePeriod=30
Jul 28 12:43:50.125838 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.125778    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2x45h"
Jul 28 12:43:50.193065 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.193022    2565 generic.go:356] "Generic (PLEG): container finished" podID="124b4672-a77f-4d4e-87b1-0785d06153e9" containerID="b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8" exitCode=0
Jul 28 12:43:50.193065 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.193061    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2x45h"
Jul 28 12:43:50.193065 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.193077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2x45h" event={"ID":"124b4672-a77f-4d4e-87b1-0785d06153e9","Type":"ContainerDied","Data":"b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8"}
Jul 28 12:43:50.193314 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.193115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2x45h" event={"ID":"124b4672-a77f-4d4e-87b1-0785d06153e9","Type":"ContainerDied","Data":"823c71affd394dcb387a97ffd998366d80192e043a1f3df87eb85edd190709bb"}
Jul 28 12:43:50.193314 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.193134    2565 scope.go:117] "RemoveContainer" containerID="b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8"
Jul 28 12:43:50.201874 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.201859    2565 scope.go:117] "RemoveContainer" containerID="b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8"
Jul 28 12:43:50.202223 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:43:50.202191    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8\": container with ID starting with b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8 not found: ID does not exist" containerID="b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8"
Jul 28 12:43:50.202274 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.202233    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8"} err="failed to get container status \"b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8\": rpc error: code = NotFound desc = could not find container \"b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8\": container with ID starting with b4a0ac78f3e12a99bc3bdc063b068d2208c042b28549a333e1bf017c879f75a8 not found: ID does not exist"
Jul 28 12:43:50.216517 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.216500    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86gq9\" (UniqueName: \"kubernetes.io/projected/124b4672-a77f-4d4e-87b1-0785d06153e9-kube-api-access-86gq9\") pod \"124b4672-a77f-4d4e-87b1-0785d06153e9\" (UID: \"124b4672-a77f-4d4e-87b1-0785d06153e9\") "
Jul 28 12:43:50.218648 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.218622    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/124b4672-a77f-4d4e-87b1-0785d06153e9-kube-api-access-86gq9" (OuterVolumeSpecName: "kube-api-access-86gq9") pod "124b4672-a77f-4d4e-87b1-0785d06153e9" (UID: "124b4672-a77f-4d4e-87b1-0785d06153e9"). InnerVolumeSpecName "kube-api-access-86gq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:43:50.317759 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.317733    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86gq9\" (UniqueName: \"kubernetes.io/projected/124b4672-a77f-4d4e-87b1-0785d06153e9-kube-api-access-86gq9\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:43:50.515457 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.515413    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2x45h"]
Jul 28 12:43:50.519240 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:50.519219    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2x45h"]
Jul 28 12:43:51.898994 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:51.898951    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="124b4672-a77f-4d4e-87b1-0785d06153e9" path="/var/lib/kubelet/pods/124b4672-a77f-4d4e-87b1-0785d06153e9/volumes"
Jul 28 12:43:55.357910 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:55.357875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:55.459367 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:55.459335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:55.556001 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:55.555945    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:58.534465 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:58.534427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:43:58.632230 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:43:58.632195    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:10.231400 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:10.231362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:31.329541 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:31.329493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:31.427779 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:31.427750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:31.847704 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:31.847672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:31.942325 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:31.942291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:32.451676 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.451631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:32.582135 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.582067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:32.682548 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.682521    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8vw2x"]
Jul 28 12:44:32.682851 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.682839    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="124b4672-a77f-4d4e-87b1-0785d06153e9" containerName="authorino"
Jul 28 12:44:32.682900 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.682852    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="124b4672-a77f-4d4e-87b1-0785d06153e9" containerName="authorino"
Jul 28 12:44:32.682943 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.682924    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="124b4672-a77f-4d4e-87b1-0785d06153e9" containerName="authorino"
Jul 28 12:44:32.685236 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.685221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x"
Jul 28 12:44:32.688392 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.688369    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 12:44:32.688511 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.688399    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-68lxs\""
Jul 28 12:44:32.700804 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.700783    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8vw2x"]
Jul 28 12:44:32.778654 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.778580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f83412d3-3120-4c48-9ce2-ab14ed74a60e-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8vw2x\" (UID: \"f83412d3-3120-4c48-9ce2-ab14ed74a60e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x"
Jul 28 12:44:32.778654 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.778613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4lx\" (UniqueName: \"kubernetes.io/projected/f83412d3-3120-4c48-9ce2-ab14ed74a60e-kube-api-access-rf4lx\") pod \"payload-processing-5cc6cd444b-8vw2x\" (UID: \"f83412d3-3120-4c48-9ce2-ab14ed74a60e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x"
Jul 28 12:44:32.879416 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.879382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f83412d3-3120-4c48-9ce2-ab14ed74a60e-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8vw2x\" (UID: \"f83412d3-3120-4c48-9ce2-ab14ed74a60e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x"
Jul 28 12:44:32.879416 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.879415    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4lx\" (UniqueName: \"kubernetes.io/projected/f83412d3-3120-4c48-9ce2-ab14ed74a60e-kube-api-access-rf4lx\") pod \"payload-processing-5cc6cd444b-8vw2x\" (UID: \"f83412d3-3120-4c48-9ce2-ab14ed74a60e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x"
Jul 28 12:44:32.880119 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.880097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f83412d3-3120-4c48-9ce2-ab14ed74a60e-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8vw2x\" (UID: \"f83412d3-3120-4c48-9ce2-ab14ed74a60e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x"
Jul 28 12:44:32.889773 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.889747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4lx\" (UniqueName: \"kubernetes.io/projected/f83412d3-3120-4c48-9ce2-ab14ed74a60e-kube-api-access-rf4lx\") pod \"payload-processing-5cc6cd444b-8vw2x\" (UID: \"f83412d3-3120-4c48-9ce2-ab14ed74a60e\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x"
Jul 28 12:44:32.995763 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:32.995735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x"
Jul 28 12:44:33.148553 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:33.148530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8vw2x"]
Jul 28 12:44:33.151008 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:44:33.150969    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf83412d3_3120_4c48_9ce2_ab14ed74a60e.slice/crio-e1c2fbf883af6fb45fbc06a9f378be2f9f71025e21b19b0c99f9d182f637f8ef WatchSource:0}: Error finding container e1c2fbf883af6fb45fbc06a9f378be2f9f71025e21b19b0c99f9d182f637f8ef: Status 404 returned error can't find the container with id e1c2fbf883af6fb45fbc06a9f378be2f9f71025e21b19b0c99f9d182f637f8ef
Jul 28 12:44:33.380678 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:33.380601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x" event={"ID":"f83412d3-3120-4c48-9ce2-ab14ed74a60e","Type":"ContainerStarted","Data":"e1c2fbf883af6fb45fbc06a9f378be2f9f71025e21b19b0c99f9d182f637f8ef"}
Jul 28 12:44:36.402452 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:36.402418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x" event={"ID":"f83412d3-3120-4c48-9ce2-ab14ed74a60e","Type":"ContainerStarted","Data":"c04e0c21bf4666bcf58f683fa75474e83dad8df398bab47a77d3e284343868c5"}
Jul 28 12:44:36.402892 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:36.402561    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x"
Jul 28 12:44:36.419951 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:36.419905    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x" podStartSLOduration=2.142692627 podStartE2EDuration="4.419888556s" totalImagesPullingTime="2.277195929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:44:36.419103798 +0000 UTC m=+885.028969508" watchObservedRunningTime="2026-07-28 12:44:36.419888556 +0000 UTC m=+885.029754279"
Jul 28 12:44:42.208027 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:42.207973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:42.298681 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:42.298646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:47.409245 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:47.409160    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8vw2x"
Jul 28 12:44:52.450007 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:52.449951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:52.547728 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:52.547666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:52.686173 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:52.686117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:56.582130 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:56.582002    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:44:56.681717 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:44:56.681685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:45:00.984273 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:00.984232    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"]
Jul 28 12:45:00.987658 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:00.987638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:00.990252 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:00.990233    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p75qd\""
Jul 28 12:45:01.005492 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.005471    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 12:45:01.005595 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.005540    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 12:45:01.006066 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.006048    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 28 12:45:01.007792 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.007772    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"]
Jul 28 12:45:01.058631 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.058595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:45:01.133560 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.133519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.133560 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.133558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.133767 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.133588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.133767 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.133703    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1784fc39-5cee-41d6-bab4-cef13020f1bc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.133767 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.133748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvrx4\" (UniqueName: \"kubernetes.io/projected/1784fc39-5cee-41d6-bab4-cef13020f1bc-kube-api-access-kvrx4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.133867 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.133841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.234824 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.234740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.234824 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.234785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1784fc39-5cee-41d6-bab4-cef13020f1bc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.234824 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.234818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvrx4\" (UniqueName: \"kubernetes.io/projected/1784fc39-5cee-41d6-bab4-cef13020f1bc-kube-api-access-kvrx4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.235131 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.234877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.235131 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.234922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.235131 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.234944    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.235277 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.235199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.235277 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.235245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.235342 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.235302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.237336 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.237312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1784fc39-5cee-41d6-bab4-cef13020f1bc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.237579 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.237561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1784fc39-5cee-41d6-bab4-cef13020f1bc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.245103 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.245082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvrx4\" (UniqueName: \"kubernetes.io/projected/1784fc39-5cee-41d6-bab4-cef13020f1bc-kube-api-access-kvrx4\") pod \"e2e-distinct-simulated-kserve-59975d69f9-slnpf\" (UID: \"1784fc39-5cee-41d6-bab4-cef13020f1bc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.297603 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.297574    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:01.432577 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.432550    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"]
Jul 28 12:45:01.435462 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.435436    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:45:01.435630 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.435612    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:45:01.435769 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:45:01.435663    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1784fc39_5cee_41d6_bab4_cef13020f1bc.slice/crio-7540f0bd7e9eb446260133ae649964eebbe2b82837e9f22262c8b8f11af08a42 WatchSource:0}: Error finding container 7540f0bd7e9eb446260133ae649964eebbe2b82837e9f22262c8b8f11af08a42: Status 404 returned error can't find the container with id 7540f0bd7e9eb446260133ae649964eebbe2b82837e9f22262c8b8f11af08a42
Jul 28 12:45:01.524497 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:01.524425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf" event={"ID":"1784fc39-5cee-41d6-bab4-cef13020f1bc","Type":"ContainerStarted","Data":"7540f0bd7e9eb446260133ae649964eebbe2b82837e9f22262c8b8f11af08a42"}
Jul 28 12:45:03.535938 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:03.535898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf" event={"ID":"1784fc39-5cee-41d6-bab4-cef13020f1bc","Type":"ContainerStarted","Data":"5f11125619b9dabaffa5d08b1e94f9f07f31527355adf82b3c880d7fc091d8ea"}
Jul 28 12:45:03.556574 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:03.556531    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf" podStartSLOduration=2.365726276 podStartE2EDuration="3.556516377s" totalImagesPullingTime="1.190790101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:45:03.554166409 +0000 UTC m=+912.164032119" watchObservedRunningTime="2026-07-28 12:45:03.556516377 +0000 UTC m=+912.166382084"
Jul 28 12:45:11.298242 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:11.298203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:11.298660 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:11.298270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:11.310693 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:11.310673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:11.586190 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:11.586118    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-slnpf"
Jul 28 12:45:13.809350 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:13.809311    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:45:21.264208 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.264174    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"]
Jul 28 12:45:21.267391 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.267375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.269518 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.269500    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 28 12:45:21.284618 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.284597    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"]
Jul 28 12:45:21.303368 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.303340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.303480 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.303388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0409bc5-adf9-4643-a5c6-861a4fce1929-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.303480 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.303416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.303480 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.303438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.303626 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.303549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.303626 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.303577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g65ch\" (UniqueName: \"kubernetes.io/projected/f0409bc5-adf9-4643-a5c6-861a4fce1929-kube-api-access-g65ch\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.319844 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.319816    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:45:21.404817 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.404787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.405033 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.404864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.405033 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.404901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g65ch\" (UniqueName: \"kubernetes.io/projected/f0409bc5-adf9-4643-a5c6-861a4fce1929-kube-api-access-g65ch\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.405033 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.404969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.405201 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.405033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0409bc5-adf9-4643-a5c6-861a4fce1929-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.405201 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.405062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.405371 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.405348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.405437 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.405372    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.405521 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.405504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.407196 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.407175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0409bc5-adf9-4643-a5c6-861a4fce1929-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.407507 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.407489    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0409bc5-adf9-4643-a5c6-861a4fce1929-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.413220 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.413201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g65ch\" (UniqueName: \"kubernetes.io/projected/f0409bc5-adf9-4643-a5c6-861a4fce1929-kube-api-access-g65ch\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9\" (UID: \"f0409bc5-adf9-4643-a5c6-861a4fce1929\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.576740 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.576657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:21.723792 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.723762    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"]
Jul 28 12:45:21.727431 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:45:21.727401    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0409bc5_adf9_4643_a5c6_861a4fce1929.slice/crio-efbf05e6361f10e2a8a3307bd378833554fb35379861ad9a875e57297d3bc228 WatchSource:0}: Error finding container efbf05e6361f10e2a8a3307bd378833554fb35379861ad9a875e57297d3bc228: Status 404 returned error can't find the container with id efbf05e6361f10e2a8a3307bd378833554fb35379861ad9a875e57297d3bc228
Jul 28 12:45:21.731694 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:21.731674    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 12:45:22.626960 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:22.626928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9" event={"ID":"f0409bc5-adf9-4643-a5c6-861a4fce1929","Type":"ContainerStarted","Data":"b19afd897f122adb7bfa51fbf9ec386e29e3b807ba672a23f87ae29d34cd3b6d"}
Jul 28 12:45:22.627362 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:22.627001    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9" event={"ID":"f0409bc5-adf9-4643-a5c6-861a4fce1929","Type":"ContainerStarted","Data":"efbf05e6361f10e2a8a3307bd378833554fb35379861ad9a875e57297d3bc228"}
Jul 28 12:45:22.651484 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:22.651439    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9" podStartSLOduration=1.371581606 podStartE2EDuration="1.651422031s" totalImagesPullingTime="279.840425ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:45:22.649605719 +0000 UTC m=+931.259471424" watchObservedRunningTime="2026-07-28 12:45:22.651422031 +0000 UTC m=+931.261287739"
Jul 28 12:45:24.959731 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:24.959696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:45:31.576868 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:31.576829    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:31.577295 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:31.576939    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:31.594100 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:31.594076    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:31.678794 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:31.678767    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9"
Jul 28 12:45:33.492585 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:33.492549    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:45:34.902748 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:34.902705    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:45:38.198879 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.198848    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"]
Jul 28 12:45:38.203930 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.203912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.220197 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.220181    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 28 12:45:38.249316 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.249270    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"]
Jul 28 12:45:38.259288 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.259262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.259446 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.259290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50be309f-4f36-4962-b6ee-a036f22caa40-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.259446 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.259321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.259446 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.259365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thhch\" (UniqueName: \"kubernetes.io/projected/50be309f-4f36-4962-b6ee-a036f22caa40-kube-api-access-thhch\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.259446 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.259433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.259680 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.259457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.287593 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.287557    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:45:38.359918 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.359881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.359918 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.359917    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50be309f-4f36-4962-b6ee-a036f22caa40-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.360178 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.359948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.360178 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.360007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thhch\" (UniqueName: \"kubernetes.io/projected/50be309f-4f36-4962-b6ee-a036f22caa40-kube-api-access-thhch\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.360178 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.360057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.360178 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.360095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.360404 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.360387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.360446 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.360407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.360528 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.360511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.362449 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.362427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50be309f-4f36-4962-b6ee-a036f22caa40-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.362695 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.362680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50be309f-4f36-4962-b6ee-a036f22caa40-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.386661 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.386636    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thhch\" (UniqueName: \"kubernetes.io/projected/50be309f-4f36-4962-b6ee-a036f22caa40-kube-api-access-thhch\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj\" (UID: \"50be309f-4f36-4962-b6ee-a036f22caa40\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.513241 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.513123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:38.670522 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.670475    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"]
Jul 28 12:45:38.672670 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:45:38.672648    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50be309f_4f36_4962_b6ee_a036f22caa40.slice/crio-69256a42b03eb1eda9f8260d8953c7836262219fd4a52ddb3d85d0bbaf5adf18 WatchSource:0}: Error finding container 69256a42b03eb1eda9f8260d8953c7836262219fd4a52ddb3d85d0bbaf5adf18: Status 404 returned error can't find the container with id 69256a42b03eb1eda9f8260d8953c7836262219fd4a52ddb3d85d0bbaf5adf18
Jul 28 12:45:38.699772 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:38.699739    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj" event={"ID":"50be309f-4f36-4962-b6ee-a036f22caa40","Type":"ContainerStarted","Data":"69256a42b03eb1eda9f8260d8953c7836262219fd4a52ddb3d85d0bbaf5adf18"}
Jul 28 12:45:39.706668 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:39.706628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj" event={"ID":"50be309f-4f36-4962-b6ee-a036f22caa40","Type":"ContainerStarted","Data":"f1a529697ef44757c19764148cd243b835ba1ccdf7627468972c16c241d51b21"}
Jul 28 12:45:39.742645 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:39.742592    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj" podStartSLOduration=1.4707396560000001 podStartE2EDuration="1.742575644s" totalImagesPullingTime="271.835988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:45:39.741022306 +0000 UTC m=+948.350888029" watchObservedRunningTime="2026-07-28 12:45:39.742575644 +0000 UTC m=+948.352441352"
Jul 28 12:45:48.513622 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:48.513582    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:48.514065 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:48.513638    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:48.526576 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:48.526548    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:45:48.763261 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:45:48.763235    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj"
Jul 28 12:46:33.725456 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:46:33.725403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:46:33.817212 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:46:33.817167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:46:34.983681 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:46:34.983650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:46:35.127380 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:46:35.127344    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:48:23.933044 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:48:23.932928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:48:23.991331 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:48:23.991300    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:48:40.847408 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:48:40.847377    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:48:42.373471 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:48:42.373424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:49:17.906924 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:49:17.906834    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:49:18.002929 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:49:18.002903    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:49:18.136313 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:49:18.136269    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:49:24.124916 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:49:24.124879    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:49:24.193682 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:49:24.193646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:49:24.297122 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:49:24.297096    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:49:24.389746 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:49:24.389661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:49:24.505029 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:49:24.504967    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:49:30.598668 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:49:30.598629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:49:30.673127 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:49:30.673080    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:50:01.467246 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:50:01.467208    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:50:01.469877 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:50:01.467337    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:50:09.016426 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:50:09.016383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:07.211238 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:51:07.211158    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:06.261916 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:52:06.261884    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:06.360320 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:52:06.360284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:53:48.882209 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:48.882134    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"]
Jul 28 12:53:48.882750 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:48.882358    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l" podUID="bfac5e5a-1e08-4b29-9544-a10cfec294e6" containerName="manager" containerID="cri-o://5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010" gracePeriod=10
Jul 28 12:53:52.840505 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:52.840453    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:53:52.950583 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:52.950555    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfac5e5a-1e08-4b29-9544-a10cfec294e6-extensions-socket-volume\") pod \"bfac5e5a-1e08-4b29-9544-a10cfec294e6\" (UID: \"bfac5e5a-1e08-4b29-9544-a10cfec294e6\") "
Jul 28 12:53:52.950737 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:52.950620    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2twv\" (UniqueName: \"kubernetes.io/projected/bfac5e5a-1e08-4b29-9544-a10cfec294e6-kube-api-access-r2twv\") pod \"bfac5e5a-1e08-4b29-9544-a10cfec294e6\" (UID: \"bfac5e5a-1e08-4b29-9544-a10cfec294e6\") "
Jul 28 12:53:52.950906 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:52.950881    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfac5e5a-1e08-4b29-9544-a10cfec294e6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bfac5e5a-1e08-4b29-9544-a10cfec294e6" (UID: "bfac5e5a-1e08-4b29-9544-a10cfec294e6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:53:52.952629 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:52.952608    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfac5e5a-1e08-4b29-9544-a10cfec294e6-kube-api-access-r2twv" (OuterVolumeSpecName: "kube-api-access-r2twv") pod "bfac5e5a-1e08-4b29-9544-a10cfec294e6" (UID: "bfac5e5a-1e08-4b29-9544-a10cfec294e6"). InnerVolumeSpecName "kube-api-access-r2twv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:53:52.992991 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:52.992956    2565 generic.go:356] "Generic (PLEG): container finished" podID="bfac5e5a-1e08-4b29-9544-a10cfec294e6" containerID="5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010" exitCode=0
Jul 28 12:53:52.993091 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:52.993019    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"
Jul 28 12:53:52.993091 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:52.993027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l" event={"ID":"bfac5e5a-1e08-4b29-9544-a10cfec294e6","Type":"ContainerDied","Data":"5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010"}
Jul 28 12:53:52.993091 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:52.993067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l" event={"ID":"bfac5e5a-1e08-4b29-9544-a10cfec294e6","Type":"ContainerDied","Data":"a23322fca0e0350835b16d39bcf12bf1424eba59544c805f66e6555ff288a8ca"}
Jul 28 12:53:52.993091 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:52.993090    2565 scope.go:117] "RemoveContainer" containerID="5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010"
Jul 28 12:53:53.002389 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:53.002374    2565 scope.go:117] "RemoveContainer" containerID="5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010"
Jul 28 12:53:53.002628 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:53:53.002607    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010\": container with ID starting with 5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010 not found: ID does not exist" containerID="5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010"
Jul 28 12:53:53.002715 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:53.002634    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010"} err="failed to get container status \"5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010\": rpc error: code = NotFound desc = could not find container \"5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010\": container with ID starting with 5381a19dc170c01fb4c4b05e029c9aa4c23cc6fea90f43ec3f6cca50b20f3010 not found: ID does not exist"
Jul 28 12:53:53.014811 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:53.014791    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"]
Jul 28 12:53:53.019462 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:53.019444    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-s4w4l"]
Jul 28 12:53:53.052183 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:53.052162    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfac5e5a-1e08-4b29-9544-a10cfec294e6-extensions-socket-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:53:53.052183 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:53.052181    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2twv\" (UniqueName: \"kubernetes.io/projected/bfac5e5a-1e08-4b29-9544-a10cfec294e6-kube-api-access-r2twv\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:53:53.900105 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:53:53.900071    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfac5e5a-1e08-4b29-9544-a10cfec294e6" path="/var/lib/kubelet/pods/bfac5e5a-1e08-4b29-9544-a10cfec294e6/volumes"
Jul 28 12:54:28.912242 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:54:28.912210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:56.794005 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:54:56.793946    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:55:01.495363 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:55:01.495252    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:55:01.496949 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:55:01.496618    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 12:55:17.655872 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:55:17.655795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:05.314864 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:05.314788    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:05.398263 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:05.398233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:45.232752 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.232717    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"]
Jul 28 12:57:45.233243 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.233113    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfac5e5a-1e08-4b29-9544-a10cfec294e6" containerName="manager"
Jul 28 12:57:45.233243 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.233125    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfac5e5a-1e08-4b29-9544-a10cfec294e6" containerName="manager"
Jul 28 12:57:45.233243 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.233187    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfac5e5a-1e08-4b29-9544-a10cfec294e6" containerName="manager"
Jul 28 12:57:45.236253 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.236238    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.242197 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.242173    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-1e44403a-kserve-self-signed-certs\""
Jul 28 12:57:45.296750 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.296724    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"]
Jul 28 12:57:45.311124 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.311088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:45.314301 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.314283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-dshm\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.314366 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.314311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f71a07-dbe7-4922-a743-bb22402d2c5e-tls-certs\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.314366 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.314329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4wvt\" (UniqueName: \"kubernetes.io/projected/91f71a07-dbe7-4922-a743-bb22402d2c5e-kube-api-access-s4wvt\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.314469 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.314438    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-home\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.314525 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.314502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-model-cache\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.314572 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.314528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-tmp-dir\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.415039 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.415011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-dshm\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.415039 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.415044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f71a07-dbe7-4922-a743-bb22402d2c5e-tls-certs\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.415264 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.415062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4wvt\" (UniqueName: \"kubernetes.io/projected/91f71a07-dbe7-4922-a743-bb22402d2c5e-kube-api-access-s4wvt\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.415264 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.415115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-home\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.415264 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.415157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-model-cache\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.415264 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.415179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-tmp-dir\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.415625 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.415586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-home\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.415916 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.415631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-tmp-dir\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.415916 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.415628    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-model-cache\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.417570 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.417552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-dshm\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.417655 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.417605    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f71a07-dbe7-4922-a743-bb22402d2c5e-tls-certs\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.432816 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.432795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4wvt\" (UniqueName: \"kubernetes.io/projected/91f71a07-dbe7-4922-a743-bb22402d2c5e-kube-api-access-s4wvt\") pod \"e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") " pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.545672 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.545597    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:45.680498 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:45.680476    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"]
Jul 28 12:57:45.683148 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:57:45.683120    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91f71a07_dbe7_4922_a743_bb22402d2c5e.slice/crio-516ae6732cc6498087ae7ea75df59c31a913d83f1db3eef754f5319792ec44e8 WatchSource:0}: Error finding container 516ae6732cc6498087ae7ea75df59c31a913d83f1db3eef754f5319792ec44e8: Status 404 returned error can't find the container with id 516ae6732cc6498087ae7ea75df59c31a913d83f1db3eef754f5319792ec44e8
Jul 28 12:57:46.057328 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:46.057293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf" event={"ID":"91f71a07-dbe7-4922-a743-bb22402d2c5e","Type":"ContainerStarted","Data":"11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270"}
Jul 28 12:57:46.057328 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:46.057331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf" event={"ID":"91f71a07-dbe7-4922-a743-bb22402d2c5e","Type":"ContainerStarted","Data":"516ae6732cc6498087ae7ea75df59c31a913d83f1db3eef754f5319792ec44e8"}
Jul 28 12:57:46.078003 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:46.077931    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf" podStartSLOduration=1.077918434 podStartE2EDuration="1.077918434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:57:46.077273916 +0000 UTC m=+1674.687139636" watchObservedRunningTime="2026-07-28 12:57:46.077918434 +0000 UTC m=+1674.687784142"
Jul 28 12:57:55.546840 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:55.546758    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:55.546840 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:55.546806    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:55.559035 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:55.559012    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:57:56.118061 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:57:56.118026    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:58:13.411087 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.411013    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"]
Jul 28 12:58:13.414712 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.414694    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.417196 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.417178    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-1e44403a-kserve-self-signed-certs\""
Jul 28 12:58:13.426496 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.426475    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"]
Jul 28 12:58:13.447045 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.447021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:58:13.469990 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.469963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-home\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.470079 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.470018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-model-cache\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.470079 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.470043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tmp-dir\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.470079 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.470070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhsqm\" (UniqueName: \"kubernetes.io/projected/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-kube-api-access-hhsqm\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.470216 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.470129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-dshm\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.470216 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.470152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tls-certs\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.571294 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.571263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-home\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.571419 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.571306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-model-cache\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.571419 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.571328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tmp-dir\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.571419 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.571361    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhsqm\" (UniqueName: \"kubernetes.io/projected/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-kube-api-access-hhsqm\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.571582 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.571419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-dshm\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.571582 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.571450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tls-certs\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.571685 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.571669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tmp-dir\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.571740 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.571707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-model-cache\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.571796 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.571747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-home\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.573809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.573789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-dshm\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.574116 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.574101    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tls-certs\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.578627 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.578606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhsqm\" (UniqueName: \"kubernetes.io/projected/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-kube-api-access-hhsqm\") pod \"e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") " pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.723679 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.723641    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:13.863658 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:13.863635    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"]
Jul 28 12:58:13.865503 ip-10-0-128-176 kubenswrapper[2565]: W0728 12:58:13.865477    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c5a9fe0_e8b3_428f_8c07_c67213ea249f.slice/crio-16e223a627822de9769dda0eb2e6c3bb1b2e50d180a64bcdfd6a36a9fd52fe1a WatchSource:0}: Error finding container 16e223a627822de9769dda0eb2e6c3bb1b2e50d180a64bcdfd6a36a9fd52fe1a: Status 404 returned error can't find the container with id 16e223a627822de9769dda0eb2e6c3bb1b2e50d180a64bcdfd6a36a9fd52fe1a
Jul 28 12:58:14.191599 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:14.191521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9" event={"ID":"7c5a9fe0-e8b3-428f-8c07-c67213ea249f","Type":"ContainerStarted","Data":"cb7337167b1de3a5e4b8f4a77f5401408e9f8cdf80e0f817dfbb449557ccf65c"}
Jul 28 12:58:14.191599 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:14.191559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9" event={"ID":"7c5a9fe0-e8b3-428f-8c07-c67213ea249f","Type":"ContainerStarted","Data":"16e223a627822de9769dda0eb2e6c3bb1b2e50d180a64bcdfd6a36a9fd52fe1a"}
Jul 28 12:58:14.208424 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:14.208380    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9" podStartSLOduration=1.208365199 podStartE2EDuration="1.208365199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:58:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:58:14.207097033 +0000 UTC m=+1702.816962742" watchObservedRunningTime="2026-07-28 12:58:14.208365199 +0000 UTC m=+1702.818230907"
Jul 28 12:58:23.724786 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:23.724743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:23.725331 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:23.724799    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:23.737393 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:23.737368    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:24.250275 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:24.250249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:32.586045 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:32.586013    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"]
Jul 28 12:58:32.608634 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:32.608608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:58:34.139200 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:34.139164    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"]
Jul 28 12:58:34.158854 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:34.158825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:58:47.605420 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.605367    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf" podUID="91f71a07-dbe7-4922-a743-bb22402d2c5e" containerName="main" containerID="cri-o://11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270" gracePeriod=45
Jul 28 12:58:47.866910 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.866852    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:58:47.989550 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.989523    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-tmp-dir\") pod \"91f71a07-dbe7-4922-a743-bb22402d2c5e\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") "
Jul 28 12:58:47.989702 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.989561    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-home\") pod \"91f71a07-dbe7-4922-a743-bb22402d2c5e\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") "
Jul 28 12:58:47.989702 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.989601    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4wvt\" (UniqueName: \"kubernetes.io/projected/91f71a07-dbe7-4922-a743-bb22402d2c5e-kube-api-access-s4wvt\") pod \"91f71a07-dbe7-4922-a743-bb22402d2c5e\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") "
Jul 28 12:58:47.989702 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.989637    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f71a07-dbe7-4922-a743-bb22402d2c5e-tls-certs\") pod \"91f71a07-dbe7-4922-a743-bb22402d2c5e\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") "
Jul 28 12:58:47.989702 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.989672    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-model-cache\") pod \"91f71a07-dbe7-4922-a743-bb22402d2c5e\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") "
Jul 28 12:58:47.989889 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.989714    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-dshm\") pod \"91f71a07-dbe7-4922-a743-bb22402d2c5e\" (UID: \"91f71a07-dbe7-4922-a743-bb22402d2c5e\") "
Jul 28 12:58:47.989889 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.989828    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "91f71a07-dbe7-4922-a743-bb22402d2c5e" (UID: "91f71a07-dbe7-4922-a743-bb22402d2c5e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:58:47.989889 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.989867    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-home" (OuterVolumeSpecName: "home") pod "91f71a07-dbe7-4922-a743-bb22402d2c5e" (UID: "91f71a07-dbe7-4922-a743-bb22402d2c5e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:58:47.990085 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.989899    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-model-cache" (OuterVolumeSpecName: "model-cache") pod "91f71a07-dbe7-4922-a743-bb22402d2c5e" (UID: "91f71a07-dbe7-4922-a743-bb22402d2c5e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:58:47.990134 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.990085    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-model-cache\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:47.990134 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.990099    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-tmp-dir\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:47.990134 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.990108    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-home\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:47.992062 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.992035    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-dshm" (OuterVolumeSpecName: "dshm") pod "91f71a07-dbe7-4922-a743-bb22402d2c5e" (UID: "91f71a07-dbe7-4922-a743-bb22402d2c5e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:58:47.992062 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.992041    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91f71a07-dbe7-4922-a743-bb22402d2c5e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "91f71a07-dbe7-4922-a743-bb22402d2c5e" (UID: "91f71a07-dbe7-4922-a743-bb22402d2c5e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:58:47.992207 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:47.992080    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91f71a07-dbe7-4922-a743-bb22402d2c5e-kube-api-access-s4wvt" (OuterVolumeSpecName: "kube-api-access-s4wvt") pod "91f71a07-dbe7-4922-a743-bb22402d2c5e" (UID: "91f71a07-dbe7-4922-a743-bb22402d2c5e"). InnerVolumeSpecName "kube-api-access-s4wvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:58:48.090998 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.090958    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91f71a07-dbe7-4922-a743-bb22402d2c5e-dshm\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:48.090998 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.090999    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4wvt\" (UniqueName: \"kubernetes.io/projected/91f71a07-dbe7-4922-a743-bb22402d2c5e-kube-api-access-s4wvt\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:48.091163 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.091010    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91f71a07-dbe7-4922-a743-bb22402d2c5e-tls-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:48.348449 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.348413    2565 generic.go:356] "Generic (PLEG): container finished" podID="91f71a07-dbe7-4922-a743-bb22402d2c5e" containerID="11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270" exitCode=0
Jul 28 12:58:48.348619 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.348460    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"
Jul 28 12:58:48.348619 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.348457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf" event={"ID":"91f71a07-dbe7-4922-a743-bb22402d2c5e","Type":"ContainerDied","Data":"11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270"}
Jul 28 12:58:48.348619 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.348558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf" event={"ID":"91f71a07-dbe7-4922-a743-bb22402d2c5e","Type":"ContainerDied","Data":"516ae6732cc6498087ae7ea75df59c31a913d83f1db3eef754f5319792ec44e8"}
Jul 28 12:58:48.348619 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.348579    2565 scope.go:117] "RemoveContainer" containerID="11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270"
Jul 28 12:58:48.357932 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.357913    2565 scope.go:117] "RemoveContainer" containerID="11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270"
Jul 28 12:58:48.358197 ip-10-0-128-176 kubenswrapper[2565]: E0728 12:58:48.358177    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270\": container with ID starting with 11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270 not found: ID does not exist" containerID="11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270"
Jul 28 12:58:48.358252 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.358205    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270"} err="failed to get container status \"11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270\": rpc error: code = NotFound desc = could not find container \"11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270\": container with ID starting with 11a295b56ddacb42ec846bffab96f1703b16b2d659218742f766bf94433be270 not found: ID does not exist"
Jul 28 12:58:48.368772 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.368752    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"]
Jul 28 12:58:48.373329 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:48.373310    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-1e44403a-kserve-7495b76b6c-29ddf"]
Jul 28 12:58:49.158517 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.158466    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9" podUID="7c5a9fe0-e8b3-428f-8c07-c67213ea249f" containerName="main" containerID="cri-o://cb7337167b1de3a5e4b8f4a77f5401408e9f8cdf80e0f817dfbb449557ccf65c" gracePeriod=45
Jul 28 12:58:49.357079 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.357046    2565 generic.go:356] "Generic (PLEG): container finished" podID="7c5a9fe0-e8b3-428f-8c07-c67213ea249f" containerID="cb7337167b1de3a5e4b8f4a77f5401408e9f8cdf80e0f817dfbb449557ccf65c" exitCode=0
Jul 28 12:58:49.357224 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.357119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9" event={"ID":"7c5a9fe0-e8b3-428f-8c07-c67213ea249f","Type":"ContainerDied","Data":"cb7337167b1de3a5e4b8f4a77f5401408e9f8cdf80e0f817dfbb449557ccf65c"}
Jul 28 12:58:49.411356 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.411303    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:49.503468 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.503435    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-dshm\") pod \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") "
Jul 28 12:58:49.503635 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.503478    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhsqm\" (UniqueName: \"kubernetes.io/projected/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-kube-api-access-hhsqm\") pod \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") "
Jul 28 12:58:49.503635 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.503511    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tls-certs\") pod \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") "
Jul 28 12:58:49.503635 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.503544    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-model-cache\") pod \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") "
Jul 28 12:58:49.503635 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.503566    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tmp-dir\") pod \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") "
Jul 28 12:58:49.503635 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.503618    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-home\") pod \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\" (UID: \"7c5a9fe0-e8b3-428f-8c07-c67213ea249f\") "
Jul 28 12:58:49.503907 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.503838    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c5a9fe0-e8b3-428f-8c07-c67213ea249f" (UID: "7c5a9fe0-e8b3-428f-8c07-c67213ea249f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:58:49.503907 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.503859    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c5a9fe0-e8b3-428f-8c07-c67213ea249f" (UID: "7c5a9fe0-e8b3-428f-8c07-c67213ea249f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:58:49.504077 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.503900    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-home" (OuterVolumeSpecName: "home") pod "7c5a9fe0-e8b3-428f-8c07-c67213ea249f" (UID: "7c5a9fe0-e8b3-428f-8c07-c67213ea249f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:58:49.504077 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.504010    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tmp-dir\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:49.504077 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.504024    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-home\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:49.504077 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.504032    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-model-cache\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:49.505660 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.505640    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-dshm" (OuterVolumeSpecName: "dshm") pod "7c5a9fe0-e8b3-428f-8c07-c67213ea249f" (UID: "7c5a9fe0-e8b3-428f-8c07-c67213ea249f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:58:49.506177 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.506153    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c5a9fe0-e8b3-428f-8c07-c67213ea249f" (UID: "7c5a9fe0-e8b3-428f-8c07-c67213ea249f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:58:49.506278 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.506177    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-kube-api-access-hhsqm" (OuterVolumeSpecName: "kube-api-access-hhsqm") pod "7c5a9fe0-e8b3-428f-8c07-c67213ea249f" (UID: "7c5a9fe0-e8b3-428f-8c07-c67213ea249f"). InnerVolumeSpecName "kube-api-access-hhsqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:58:49.604403 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.604369    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhsqm\" (UniqueName: \"kubernetes.io/projected/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-kube-api-access-hhsqm\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:49.604403 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.604394    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-tls-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:49.604403 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.604403    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c5a9fe0-e8b3-428f-8c07-c67213ea249f-dshm\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 12:58:49.900202 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:49.900170    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91f71a07-dbe7-4922-a743-bb22402d2c5e" path="/var/lib/kubelet/pods/91f71a07-dbe7-4922-a743-bb22402d2c5e/volumes"
Jul 28 12:58:50.362940 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:50.362913    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"
Jul 28 12:58:50.363375 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:50.362950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9" event={"ID":"7c5a9fe0-e8b3-428f-8c07-c67213ea249f","Type":"ContainerDied","Data":"16e223a627822de9769dda0eb2e6c3bb1b2e50d180a64bcdfd6a36a9fd52fe1a"}
Jul 28 12:58:50.363375 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:50.363007    2565 scope.go:117] "RemoveContainer" containerID="cb7337167b1de3a5e4b8f4a77f5401408e9f8cdf80e0f817dfbb449557ccf65c"
Jul 28 12:58:50.379812 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:50.379792    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"]
Jul 28 12:58:50.383379 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:50.383359    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-1e44403a-kserve-85897cbc8c-h8gw9"]
Jul 28 12:58:51.899645 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:58:51.899610    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c5a9fe0-e8b3-428f-8c07-c67213ea249f" path="/var/lib/kubelet/pods/7c5a9fe0-e8b3-428f-8c07-c67213ea249f/volumes"
Jul 28 12:59:36.926236 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:59:36.926206    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:36.996809 ip-10-0-128-176 kubenswrapper[2565]: I0728 12:59:36.996776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:00.148387 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.148357    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn"]
Jul 28 13:00:00.148816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.148713    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91f71a07-dbe7-4922-a743-bb22402d2c5e" containerName="main"
Jul 28 13:00:00.148816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.148724    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="91f71a07-dbe7-4922-a743-bb22402d2c5e" containerName="main"
Jul 28 13:00:00.148816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.148751    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c5a9fe0-e8b3-428f-8c07-c67213ea249f" containerName="main"
Jul 28 13:00:00.148816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.148756    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c5a9fe0-e8b3-428f-8c07-c67213ea249f" containerName="main"
Jul 28 13:00:00.148816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.148811    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="91f71a07-dbe7-4922-a743-bb22402d2c5e" containerName="main"
Jul 28 13:00:00.148997 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.148822    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c5a9fe0-e8b3-428f-8c07-c67213ea249f" containerName="main"
Jul 28 13:00:00.151753 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.151737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn"
Jul 28 13:00:00.154034 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.154015    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5hqn\""
Jul 28 13:00:00.157717 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.157695    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn"]
Jul 28 13:00:00.162920 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.162899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn"
Jul 28 13:00:00.305591 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.305559    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn"]
Jul 28 13:00:00.309132 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:00:00.309104    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a32e11_278c_4eff_b114_519987cc9caf.slice/crio-eebf84946f4b46cd5a4b4d42ab7072f5f5ac84f0e3f9abc8f06302da3dce6b15 WatchSource:0}: Error finding container eebf84946f4b46cd5a4b4d42ab7072f5f5ac84f0e3f9abc8f06302da3dce6b15: Status 404 returned error can't find the container with id eebf84946f4b46cd5a4b4d42ab7072f5f5ac84f0e3f9abc8f06302da3dce6b15
Jul 28 13:00:00.311151 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.311133    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:00:00.687440 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:00.687400    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn" event={"ID":"d5a32e11-278c-4eff-b114-519987cc9caf","Type":"ContainerStarted","Data":"eebf84946f4b46cd5a4b4d42ab7072f5f5ac84f0e3f9abc8f06302da3dce6b15"}
Jul 28 13:00:01.523484 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:01.523379    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:00:01.537236 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:01.525677    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:00:03.704266 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:03.704229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn" event={"ID":"d5a32e11-278c-4eff-b114-519987cc9caf","Type":"ContainerStarted","Data":"e98a0e32738b2c934ca428689c339765fe84372acf0683b1898690bde1a7cffe"}
Jul 28 13:00:03.728233 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:03.728186    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn" podStartSLOduration=1.082986872 podStartE2EDuration="3.728171023s" totalImagesPullingTime="2.645184151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:00:03.72676602 +0000 UTC m=+1812.336631728" watchObservedRunningTime="2026-07-28 13:00:03.728171023 +0000 UTC m=+1812.338036730"
Jul 28 13:00:04.710656 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:04.710623    2565 generic.go:356] "Generic (PLEG): container finished" podID="d5a32e11-278c-4eff-b114-519987cc9caf" containerID="e98a0e32738b2c934ca428689c339765fe84372acf0683b1898690bde1a7cffe" exitCode=0
Jul 28 13:00:04.711101 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:04.710668    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn" event={"ID":"d5a32e11-278c-4eff-b114-519987cc9caf","Type":"ContainerDied","Data":"e98a0e32738b2c934ca428689c339765fe84372acf0683b1898690bde1a7cffe"}
Jul 28 13:00:05.848996 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:05.848960    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn"
Jul 28 13:00:06.720630 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:06.720602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn" event={"ID":"d5a32e11-278c-4eff-b114-519987cc9caf","Type":"ContainerDied","Data":"eebf84946f4b46cd5a4b4d42ab7072f5f5ac84f0e3f9abc8f06302da3dce6b15"}
Jul 28 13:00:06.720630 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:06.720626    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754060-d4rfn"
Jul 28 13:00:06.720846 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:00:06.720648    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eebf84946f4b46cd5a4b4d42ab7072f5f5ac84f0e3f9abc8f06302da3dce6b15"
Jul 28 13:01:41.889902 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:01:41.889869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:03.901134 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:03.901103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:07.168058 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:07.168019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:07.252410 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:07.252378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:07.614816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:07.614784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:13.451157 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:13.451117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:13.552319 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:13.552281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:13.688482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:13.688448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:13.987135 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:13.987099    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"]
Jul 28 13:02:13.987850 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:13.987829    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a32e11-278c-4eff-b114-519987cc9caf" containerName="cleanup"
Jul 28 13:02:13.987922 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:13.987855    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a32e11-278c-4eff-b114-519987cc9caf" containerName="cleanup"
Jul 28 13:02:13.988098 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:13.988085    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5a32e11-278c-4eff-b114-519987cc9caf" containerName="cleanup"
Jul 28 13:02:13.991924 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:13.991892    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:13.994154 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:13.994132    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d3416997-openshift-default-dockercfg-jg27z\""
Jul 28 13:02:13.994280 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:13.994236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 13:02:14.013174 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.013150    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"]
Jul 28 13:02:14.014607 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.014583    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:14.134303 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.134262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-credential-socket\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.134485 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.134317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-envoy\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.134485 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.134386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-podinfo\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.134485 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.134440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-socket\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.134651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.134519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-certs\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.134651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.134559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istiod-ca-cert\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.134651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.134605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-data\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.134651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.134631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-token\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.134794 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.134676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpgbx\" (UniqueName: \"kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-kube-api-access-mpgbx\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235223 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-data\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235223 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-token\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235472 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpgbx\" (UniqueName: \"kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-kube-api-access-mpgbx\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235472 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-credential-socket\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235472 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-envoy\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235472 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-podinfo\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235472 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-socket\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235472 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-certs\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235472 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istiod-ca-cert\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235837 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-data\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235837 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-credential-socket\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.235837 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.235822    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-socket\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.236140 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.236123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istiod-ca-cert\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.236196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.236146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-certs\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.237707 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.237647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-envoy\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.238022 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.237958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-podinfo\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.242558 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.242532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-token\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.242859 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.242839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpgbx\" (UniqueName: \"kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-kube-api-access-mpgbx\") pod \"e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") " pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.254549 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.254528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:14.302544 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.302515    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:14.439368 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:14.439346    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"]
Jul 28 13:02:14.441677 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:02:14.441648    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21164a08_1a17_4d03_b78f_d7ea4a9ae08b.slice/crio-a83625b8c1744d9acd868544d5d864c2b23a6e00d64b130c16b95dd01913cb02 WatchSource:0}: Error finding container a83625b8c1744d9acd868544d5d864c2b23a6e00d64b130c16b95dd01913cb02: Status 404 returned error can't find the container with id a83625b8c1744d9acd868544d5d864c2b23a6e00d64b130c16b95dd01913cb02
Jul 28 13:02:15.316307 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:15.316264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" event={"ID":"21164a08-1a17-4d03-b78f-d7ea4a9ae08b","Type":"ContainerStarted","Data":"a83625b8c1744d9acd868544d5d864c2b23a6e00d64b130c16b95dd01913cb02"}
Jul 28 13:02:17.018754 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:17.018720    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:02:17.019181 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:17.018790    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:02:17.019181 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:17.018819    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:02:17.330427 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:17.330338    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" event={"ID":"21164a08-1a17-4d03-b78f-d7ea4a9ae08b","Type":"ContainerStarted","Data":"cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b"}
Jul 28 13:02:18.302869 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:18.302829    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:18.307856 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:18.307832    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:18.327380 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:18.327300    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" podStartSLOduration=2.755424542 podStartE2EDuration="5.327285208s" totalImagesPullingTime="2.571860666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:02:17.350481147 +0000 UTC m=+1945.960346854" watchObservedRunningTime="2026-07-28 13:02:18.327285208 +0000 UTC m=+1946.937150953"
Jul 28 13:02:18.335596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:18.335576    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:18.336392 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:18.336376    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:18.795339 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:18.795308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:18.882405 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:18.882374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:19.124424 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.124340    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:19.226326 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.226285    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:19.478237 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.478204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:19.585780 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.585751    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:19.590143 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.590121    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"]
Jul 28 13:02:19.593696 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.593681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:19.597454 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.597433    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d3416997\""
Jul 28 13:02:19.597558 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.597476    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d3416997-dockercfg-dwxxg\""
Jul 28 13:02:19.606325 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.606306    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"]
Jul 28 13:02:19.616145 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.616122    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"]
Jul 28 13:02:19.619429 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.619405    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:19.629004 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.628964    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"]
Jul 28 13:02:19.693007 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.692954    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27a4043f-1dac-4235-8754-0a1f55e204ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2\" (UID: \"27a4043f-1dac-4235-8754-0a1f55e204ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:19.693158 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.693044    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gljh\" (UniqueName: \"kubernetes.io/projected/27a4043f-1dac-4235-8754-0a1f55e204ca-kube-api-access-7gljh\") pod \"payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2\" (UID: \"27a4043f-1dac-4235-8754-0a1f55e204ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:19.793861 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.793763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl5mv\" (UniqueName: \"kubernetes.io/projected/6ee895ab-1132-4eba-8213-5819ac50fa5c-kube-api-access-nl5mv\") pod \"payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz\" (UID: \"6ee895ab-1132-4eba-8213-5819ac50fa5c\") " pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:19.793861 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.793823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27a4043f-1dac-4235-8754-0a1f55e204ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2\" (UID: \"27a4043f-1dac-4235-8754-0a1f55e204ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:19.794134 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.793864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ee895ab-1132-4eba-8213-5819ac50fa5c-plugins-config-volume\") pod \"payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz\" (UID: \"6ee895ab-1132-4eba-8213-5819ac50fa5c\") " pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:19.794134 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.793895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gljh\" (UniqueName: \"kubernetes.io/projected/27a4043f-1dac-4235-8754-0a1f55e204ca-kube-api-access-7gljh\") pod \"payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2\" (UID: \"27a4043f-1dac-4235-8754-0a1f55e204ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:19.794547 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.794528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27a4043f-1dac-4235-8754-0a1f55e204ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2\" (UID: \"27a4043f-1dac-4235-8754-0a1f55e204ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:19.801083 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.801061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gljh\" (UniqueName: \"kubernetes.io/projected/27a4043f-1dac-4235-8754-0a1f55e204ca-kube-api-access-7gljh\") pod \"payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2\" (UID: \"27a4043f-1dac-4235-8754-0a1f55e204ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:19.895083 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.895051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ee895ab-1132-4eba-8213-5819ac50fa5c-plugins-config-volume\") pod \"payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz\" (UID: \"6ee895ab-1132-4eba-8213-5819ac50fa5c\") " pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:19.895238 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.895148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl5mv\" (UniqueName: \"kubernetes.io/projected/6ee895ab-1132-4eba-8213-5819ac50fa5c-kube-api-access-nl5mv\") pod \"payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz\" (UID: \"6ee895ab-1132-4eba-8213-5819ac50fa5c\") " pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:19.895922 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.895900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ee895ab-1132-4eba-8213-5819ac50fa5c-plugins-config-volume\") pod \"payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz\" (UID: \"6ee895ab-1132-4eba-8213-5819ac50fa5c\") " pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:19.902517 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.902492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl5mv\" (UniqueName: \"kubernetes.io/projected/6ee895ab-1132-4eba-8213-5819ac50fa5c-kube-api-access-nl5mv\") pod \"payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz\" (UID: \"6ee895ab-1132-4eba-8213-5819ac50fa5c\") " pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:19.904328 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.904312    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:19.931192 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:19.931169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:20.087910 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:20.087884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"]
Jul 28 13:02:20.090057 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:02:20.090026    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee895ab_1132_4eba_8213_5819ac50fa5c.slice/crio-c749cd4247f38d43e61cb3156f8368c8074f598c798318ed5a6f12e4e669f1d6 WatchSource:0}: Error finding container c749cd4247f38d43e61cb3156f8368c8074f598c798318ed5a6f12e4e669f1d6: Status 404 returned error can't find the container with id c749cd4247f38d43e61cb3156f8368c8074f598c798318ed5a6f12e4e669f1d6
Jul 28 13:02:20.279214 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:20.279189    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"]
Jul 28 13:02:20.281315 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:02:20.281291    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a4043f_1dac_4235_8754_0a1f55e204ca.slice/crio-1f8a16e36dd255170f46854190d702547e6a27c50ff5db1203a372693af4eb16 WatchSource:0}: Error finding container 1f8a16e36dd255170f46854190d702547e6a27c50ff5db1203a372693af4eb16: Status 404 returned error can't find the container with id 1f8a16e36dd255170f46854190d702547e6a27c50ff5db1203a372693af4eb16
Jul 28 13:02:20.347133 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:20.347077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz" event={"ID":"6ee895ab-1132-4eba-8213-5819ac50fa5c","Type":"ContainerStarted","Data":"f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835"}
Jul 28 13:02:20.347133 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:20.347122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz" event={"ID":"6ee895ab-1132-4eba-8213-5819ac50fa5c","Type":"ContainerStarted","Data":"c749cd4247f38d43e61cb3156f8368c8074f598c798318ed5a6f12e4e669f1d6"}
Jul 28 13:02:20.347312 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:20.347162    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:20.348673 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:20.348649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2" event={"ID":"27a4043f-1dac-4235-8754-0a1f55e204ca","Type":"ContainerStarted","Data":"6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b"}
Jul 28 13:02:20.348742 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:20.348700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2" event={"ID":"27a4043f-1dac-4235-8754-0a1f55e204ca","Type":"ContainerStarted","Data":"1f8a16e36dd255170f46854190d702547e6a27c50ff5db1203a372693af4eb16"}
Jul 28 13:02:20.348811 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:20.348798    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:20.379341 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:20.379304    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz" podStartSLOduration=1.3792882899999999 podStartE2EDuration="1.37928829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:02:20.376473268 +0000 UTC m=+1948.986338976" watchObservedRunningTime="2026-07-28 13:02:20.37928829 +0000 UTC m=+1948.989153989"
Jul 28 13:02:20.405430 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:20.405366    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2" podStartSLOduration=1.405345648 podStartE2EDuration="1.405345648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:02:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:02:20.401810927 +0000 UTC m=+1949.011676637" watchObservedRunningTime="2026-07-28 13:02:20.405345648 +0000 UTC m=+1949.015211364"
Jul 28 13:02:28.880403 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:28.880359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:31.356133 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:31.356098    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:31.356660 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:31.356193    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:31.408815 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:31.408780    2565 generic.go:356] "Generic (PLEG): container finished" podID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerID="cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b" exitCode=0
Jul 28 13:02:31.408997 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:31.408855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" event={"ID":"21164a08-1a17-4d03-b78f-d7ea4a9ae08b","Type":"ContainerDied","Data":"cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b"}
Jul 28 13:02:31.409277 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:31.409259    2565 scope.go:117] "RemoveContainer" containerID="cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b"
Jul 28 13:02:31.411285 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:31.411249    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:02:31.411653 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:31.411334    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:02:31.411653 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:31.411369    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:02:32.416640 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:32.416602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" event={"ID":"21164a08-1a17-4d03-b78f-d7ea4a9ae08b","Type":"ContainerStarted","Data":"bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b"}
Jul 28 13:02:33.303917 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:33.303871    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:33.304246 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:33.304097    2565 patch_prober.go:28] interesting pod/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 28 13:02:33.304469 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:33.304427    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 28 13:02:33.335781 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:33.335748    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:34.303746 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:34.303700    2565 patch_prober.go:28] interesting pod/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 28 13:02:34.304260 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:34.303768    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 28 13:02:35.303800 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:35.303373    2565 patch_prober.go:28] interesting pod/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 28 13:02:35.303800 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:35.303429    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 28 13:02:36.303768 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:36.303731    2565 patch_prober.go:28] interesting pod/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 28 13:02:36.304071 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:36.304040    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 28 13:02:37.307142 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:37.307112    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:37.308154 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:37.308137    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:02:44.255920 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:44.255838    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"]
Jul 28 13:02:44.260222 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:44.260204    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"
Jul 28 13:02:44.262376 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:44.262350    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 13:02:44.262515 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:44.262400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-j5hqn\""
Jul 28 13:02:44.265622 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:44.265599    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"]
Jul 28 13:02:44.325487 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:44.325458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b2a484-71b3-438d-bb4d-1b178c76390d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d3416997-pqddg\" (UID: \"b0b2a484-71b3-438d-bb4d-1b178c76390d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"
Jul 28 13:02:44.426579 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:44.426532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b2a484-71b3-438d-bb4d-1b178c76390d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d3416997-pqddg\" (UID: \"b0b2a484-71b3-438d-bb4d-1b178c76390d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"
Jul 28 13:02:44.427200 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:44.427184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b2a484-71b3-438d-bb4d-1b178c76390d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-d3416997-pqddg\" (UID: \"b0b2a484-71b3-438d-bb4d-1b178c76390d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"
Jul 28 13:02:44.572484 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:44.572396    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"
Jul 28 13:02:44.709328 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:44.709298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"]
Jul 28 13:02:44.712539 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:02:44.712513    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b2a484_71b3_438d_bb4d_1b178c76390d.slice/crio-f4ca1ee048e400db60c9331c32aeb174aed84ea503f237e9a5b3fc96724a110d WatchSource:0}: Error finding container f4ca1ee048e400db60c9331c32aeb174aed84ea503f237e9a5b3fc96724a110d: Status 404 returned error can't find the container with id f4ca1ee048e400db60c9331c32aeb174aed84ea503f237e9a5b3fc96724a110d
Jul 28 13:02:45.485838 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:45.485800    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg" event={"ID":"b0b2a484-71b3-438d-bb4d-1b178c76390d","Type":"ContainerStarted","Data":"496dcc2bd1a83b985456d045b220ac37b998885131d1873760358c4d22eab99f"}
Jul 28 13:02:45.486192 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:45.485850    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg" event={"ID":"b0b2a484-71b3-438d-bb4d-1b178c76390d","Type":"ContainerStarted","Data":"f4ca1ee048e400db60c9331c32aeb174aed84ea503f237e9a5b3fc96724a110d"}
Jul 28 13:02:45.504127 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:45.504088    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg" podStartSLOduration=1.504072475 podStartE2EDuration="1.504072475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:02:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:02:45.502062514 +0000 UTC m=+1974.111928222" watchObservedRunningTime="2026-07-28 13:02:45.504072475 +0000 UTC m=+1974.113938242"
Jul 28 13:02:46.492097 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:46.492064    2565 generic.go:356] "Generic (PLEG): container finished" podID="b0b2a484-71b3-438d-bb4d-1b178c76390d" containerID="496dcc2bd1a83b985456d045b220ac37b998885131d1873760358c4d22eab99f" exitCode=0
Jul 28 13:02:46.492486 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:46.492119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg" event={"ID":"b0b2a484-71b3-438d-bb4d-1b178c76390d","Type":"ContainerDied","Data":"496dcc2bd1a83b985456d045b220ac37b998885131d1873760358c4d22eab99f"}
Jul 28 13:02:47.632630 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:47.632604    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"
Jul 28 13:02:47.758573 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:47.758497    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b2a484-71b3-438d-bb4d-1b178c76390d-maas-api-service-ca\") pod \"b0b2a484-71b3-438d-bb4d-1b178c76390d\" (UID: \"b0b2a484-71b3-438d-bb4d-1b178c76390d\") "
Jul 28 13:02:47.758820 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:47.758799    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b2a484-71b3-438d-bb4d-1b178c76390d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b0b2a484-71b3-438d-bb4d-1b178c76390d" (UID: "b0b2a484-71b3-438d-bb4d-1b178c76390d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:02:47.859866 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:47.859830    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0b2a484-71b3-438d-bb4d-1b178c76390d-maas-api-service-ca\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:02:48.503095 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:48.503057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg" event={"ID":"b0b2a484-71b3-438d-bb4d-1b178c76390d","Type":"ContainerDied","Data":"f4ca1ee048e400db60c9331c32aeb174aed84ea503f237e9a5b3fc96724a110d"}
Jul 28 13:02:48.503095 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:48.503080    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"
Jul 28 13:02:48.503311 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:48.503118    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4ca1ee048e400db60c9331c32aeb174aed84ea503f237e9a5b3fc96724a110d"
Jul 28 13:02:54.702203 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:54.702171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:54.724969 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:54.724935    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"]
Jul 28 13:02:54.725565 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:54.725526    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz" podUID="6ee895ab-1132-4eba-8213-5819ac50fa5c" containerName="payload-processing" containerID="cri-o://f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835" gracePeriod=30
Jul 28 13:02:54.732103 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:54.732080    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"]
Jul 28 13:02:54.732367 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:54.732336    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2" podUID="27a4043f-1dac-4235-8754-0a1f55e204ca" containerName="payload-pre-processing" containerID="cri-o://6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b" gracePeriod=30
Jul 28 13:02:54.766691 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:54.766665    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:54.832315 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:54.832276    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:55.005313 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.005290    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:55.035435 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.035412    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:55.123182 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.123149    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27a4043f-1dac-4235-8754-0a1f55e204ca-plugins-config-volume\") pod \"27a4043f-1dac-4235-8754-0a1f55e204ca\" (UID: \"27a4043f-1dac-4235-8754-0a1f55e204ca\") "
Jul 28 13:02:55.123182 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.123183    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl5mv\" (UniqueName: \"kubernetes.io/projected/6ee895ab-1132-4eba-8213-5819ac50fa5c-kube-api-access-nl5mv\") pod \"6ee895ab-1132-4eba-8213-5819ac50fa5c\" (UID: \"6ee895ab-1132-4eba-8213-5819ac50fa5c\") "
Jul 28 13:02:55.123436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.123235    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ee895ab-1132-4eba-8213-5819ac50fa5c-plugins-config-volume\") pod \"6ee895ab-1132-4eba-8213-5819ac50fa5c\" (UID: \"6ee895ab-1132-4eba-8213-5819ac50fa5c\") "
Jul 28 13:02:55.123436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.123412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gljh\" (UniqueName: \"kubernetes.io/projected/27a4043f-1dac-4235-8754-0a1f55e204ca-kube-api-access-7gljh\") pod \"27a4043f-1dac-4235-8754-0a1f55e204ca\" (UID: \"27a4043f-1dac-4235-8754-0a1f55e204ca\") "
Jul 28 13:02:55.123555 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.123535    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ee895ab-1132-4eba-8213-5819ac50fa5c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ee895ab-1132-4eba-8213-5819ac50fa5c" (UID: "6ee895ab-1132-4eba-8213-5819ac50fa5c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:02:55.123611 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.123587    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a4043f-1dac-4235-8754-0a1f55e204ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "27a4043f-1dac-4235-8754-0a1f55e204ca" (UID: "27a4043f-1dac-4235-8754-0a1f55e204ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:02:55.123788 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.123771    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/27a4043f-1dac-4235-8754-0a1f55e204ca-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:02:55.123851 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.123794    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ee895ab-1132-4eba-8213-5819ac50fa5c-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:02:55.125649 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.125626    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ee895ab-1132-4eba-8213-5819ac50fa5c-kube-api-access-nl5mv" (OuterVolumeSpecName: "kube-api-access-nl5mv") pod "6ee895ab-1132-4eba-8213-5819ac50fa5c" (UID: "6ee895ab-1132-4eba-8213-5819ac50fa5c"). InnerVolumeSpecName "kube-api-access-nl5mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:02:55.125729 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.125682    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27a4043f-1dac-4235-8754-0a1f55e204ca-kube-api-access-7gljh" (OuterVolumeSpecName: "kube-api-access-7gljh") pod "27a4043f-1dac-4235-8754-0a1f55e204ca" (UID: "27a4043f-1dac-4235-8754-0a1f55e204ca"). InnerVolumeSpecName "kube-api-access-7gljh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:02:55.225321 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.225288    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gljh\" (UniqueName: \"kubernetes.io/projected/27a4043f-1dac-4235-8754-0a1f55e204ca-kube-api-access-7gljh\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:02:55.225321 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.225315    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl5mv\" (UniqueName: \"kubernetes.io/projected/6ee895ab-1132-4eba-8213-5819ac50fa5c-kube-api-access-nl5mv\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:02:55.536932 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.536896    2565 generic.go:356] "Generic (PLEG): container finished" podID="6ee895ab-1132-4eba-8213-5819ac50fa5c" containerID="f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835" exitCode=0
Jul 28 13:02:55.537149 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.536956    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"
Jul 28 13:02:55.537149 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.536967    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz" event={"ID":"6ee895ab-1132-4eba-8213-5819ac50fa5c","Type":"ContainerDied","Data":"f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835"}
Jul 28 13:02:55.537149 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.537068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz" event={"ID":"6ee895ab-1132-4eba-8213-5819ac50fa5c","Type":"ContainerDied","Data":"c749cd4247f38d43e61cb3156f8368c8074f598c798318ed5a6f12e4e669f1d6"}
Jul 28 13:02:55.537149 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.537095    2565 scope.go:117] "RemoveContainer" containerID="f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835"
Jul 28 13:02:55.538352 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.538328    2565 generic.go:356] "Generic (PLEG): container finished" podID="27a4043f-1dac-4235-8754-0a1f55e204ca" containerID="6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b" exitCode=0
Jul 28 13:02:55.538477 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.538382    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"
Jul 28 13:02:55.538477 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.538405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2" event={"ID":"27a4043f-1dac-4235-8754-0a1f55e204ca","Type":"ContainerDied","Data":"6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b"}
Jul 28 13:02:55.538477 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.538445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2" event={"ID":"27a4043f-1dac-4235-8754-0a1f55e204ca","Type":"ContainerDied","Data":"1f8a16e36dd255170f46854190d702547e6a27c50ff5db1203a372693af4eb16"}
Jul 28 13:02:55.547699 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.547685    2565 scope.go:117] "RemoveContainer" containerID="f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835"
Jul 28 13:02:55.548089 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:02:55.548067    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835\": container with ID starting with f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835 not found: ID does not exist" containerID="f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835"
Jul 28 13:02:55.548185 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.548096    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835"} err="failed to get container status \"f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835\": rpc error: code = NotFound desc = could not find container \"f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835\": container with ID starting with f41006ba267ae90bf7be9e47ee449d6a2223804156bfb4bf98b15561195c0835 not found: ID does not exist"
Jul 28 13:02:55.548185 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.548115    2565 scope.go:117] "RemoveContainer" containerID="6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b"
Jul 28 13:02:55.558946 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.558924    2565 scope.go:117] "RemoveContainer" containerID="6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b"
Jul 28 13:02:55.559396 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:02:55.559373    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b\": container with ID starting with 6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b not found: ID does not exist" containerID="6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b"
Jul 28 13:02:55.559474 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.559407    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b"} err="failed to get container status \"6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b\": rpc error: code = NotFound desc = could not find container \"6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b\": container with ID starting with 6e73c4c8b2e14ab8780e261e1a926ee1cfb44405743354f820c8d712132e922b not found: ID does not exist"
Jul 28 13:02:55.559716 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.559698    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"]
Jul 28 13:02:55.562249 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.562232    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d3416997-6ff84bf886-h74kz"]
Jul 28 13:02:55.571390 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.571369    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"]
Jul 28 13:02:55.575545 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.575528    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d3416997-79bf5b9bd4-rkwt2"]
Jul 28 13:02:55.900337 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.900253    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27a4043f-1dac-4235-8754-0a1f55e204ca" path="/var/lib/kubelet/pods/27a4043f-1dac-4235-8754-0a1f55e204ca/volumes"
Jul 28 13:02:55.900696 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:55.900602    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ee895ab-1132-4eba-8213-5819ac50fa5c" path="/var/lib/kubelet/pods/6ee895ab-1132-4eba-8213-5819ac50fa5c/volumes"
Jul 28 13:02:59.346043 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:59.345974    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:59.403519 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:59.403467    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"]
Jul 28 13:02:59.405548 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:59.405524    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-d3416997-pqddg"]
Jul 28 13:02:59.537408 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:59.537368    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"]
Jul 28 13:02:59.537613 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:59.537592    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy" containerID="cri-o://bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b" gracePeriod=30
Jul 28 13:02:59.560628 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:59.560592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:59.799038 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:59.798945    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:59.901297 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:02:59.901264    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0b2a484-71b3-438d-bb4d-1b178c76390d" path="/var/lib/kubelet/pods/b0b2a484-71b3-438d-bb4d-1b178c76390d/volumes"
Jul 28 13:03:00.045886 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.045845    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:00.142577 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.142489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:00.383300 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.383255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:00.659236 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.659196    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"]
Jul 28 13:03:00.659648 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.659630    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee895ab-1132-4eba-8213-5819ac50fa5c" containerName="payload-processing"
Jul 28 13:03:00.659735 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.659651    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee895ab-1132-4eba-8213-5819ac50fa5c" containerName="payload-processing"
Jul 28 13:03:00.659735 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.659665    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b2a484-71b3-438d-bb4d-1b178c76390d" containerName="revoke-keys"
Jul 28 13:03:00.659735 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.659673    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b2a484-71b3-438d-bb4d-1b178c76390d" containerName="revoke-keys"
Jul 28 13:03:00.659735 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.659708    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a4043f-1dac-4235-8754-0a1f55e204ca" containerName="payload-pre-processing"
Jul 28 13:03:00.659735 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.659717    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a4043f-1dac-4235-8754-0a1f55e204ca" containerName="payload-pre-processing"
Jul 28 13:03:00.659963 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.659795    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ee895ab-1132-4eba-8213-5819ac50fa5c" containerName="payload-processing"
Jul 28 13:03:00.659963 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.659811    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a4043f-1dac-4235-8754-0a1f55e204ca" containerName="payload-pre-processing"
Jul 28 13:03:00.659963 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.659824    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0b2a484-71b3-438d-bb4d-1b178c76390d" containerName="revoke-keys"
Jul 28 13:03:00.666337 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.665195    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.669176 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.669153    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-853a1b3f-gw-openshift-default-dockercfg-zm2bs\""
Jul 28 13:03:00.684463 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.684428    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"]
Jul 28 13:03:00.739135 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.739106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:00.776228 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.776185    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-token\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.776228 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.776228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3d6c021-950f-4686-8b16-c6c18dd721ce-istiod-ca-cert\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.776506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.776248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-podinfo\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.776506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.776330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlq5m\" (UniqueName: \"kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-kube-api-access-hlq5m\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.776506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.776390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-envoy\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.776506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.776412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-credential-socket\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.776506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.776479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-data\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.776506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.776499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-socket\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.776828 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.776528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-certs\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.877249 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.877205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlq5m\" (UniqueName: \"kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-kube-api-access-hlq5m\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.877476 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.877273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-envoy\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.877476 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.877292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-credential-socket\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.877476 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.877341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-data\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.877476 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.877365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-socket\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.877476 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.877416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-certs\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.877476 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.877456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-token\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.877787 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.877484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3d6c021-950f-4686-8b16-c6c18dd721ce-istiod-ca-cert\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.877787 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.877507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-podinfo\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.877932 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.877910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-certs\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.878271 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.878250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-data\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.878363 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.878333    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3d6c021-950f-4686-8b16-c6c18dd721ce-istiod-ca-cert\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.878468 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.878443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-socket\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.878608 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.878587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-credential-socket\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.879945 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.879921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-envoy\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.880204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.880185    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-podinfo\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.886138 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.886110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-token\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.886284 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.886259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlq5m\" (UniqueName: \"kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-kube-api-access-hlq5m\") pod \"e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") " pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:00.976973 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:00.976938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:01.119048 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:01.118965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"]
Jul 28 13:03:01.121822 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:03:01.121791    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d6c021_950f_4686_8b16_c6c18dd721ce.slice/crio-9af02beb5171a010d74a42f2706273cdfd9a9582406062ebd23eb608b68ee78c WatchSource:0}: Error finding container 9af02beb5171a010d74a42f2706273cdfd9a9582406062ebd23eb608b68ee78c: Status 404 returned error can't find the container with id 9af02beb5171a010d74a42f2706273cdfd9a9582406062ebd23eb608b68ee78c
Jul 28 13:03:01.124067 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:01.124024    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:03:01.124145 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:01.124120    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:03:01.124192 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:01.124164    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:03:01.224592 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:01.224558    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:01.574465 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:01.574419    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" event={"ID":"f3d6c021-950f-4686-8b16-c6c18dd721ce","Type":"ContainerStarted","Data":"d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1"}
Jul 28 13:03:01.575024 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:01.574483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" event={"ID":"f3d6c021-950f-4686-8b16-c6c18dd721ce","Type":"ContainerStarted","Data":"9af02beb5171a010d74a42f2706273cdfd9a9582406062ebd23eb608b68ee78c"}
Jul 28 13:03:01.600231 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:01.600179    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" podStartSLOduration=1.60016004 podStartE2EDuration="1.60016004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:03:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:03:01.598109334 +0000 UTC m=+1990.207975044" watchObservedRunningTime="2026-07-28 13:03:01.60016004 +0000 UTC m=+1990.210025754"
Jul 28 13:03:01.977125 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:01.977090    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:02.982362 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:02.982332    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:03.063216 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:03.063181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:03.179648 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:03.179616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:03.584632 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:03.584602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:03.585686 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:03.585668    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:03.589116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:03.589091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:03.757406 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:03.757347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:03.900913 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:03.900824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:04.013995 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.013953    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"]
Jul 28 13:03:04.016416 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.016401    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:04.018462 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.018434    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-853a1b3f\""
Jul 28 13:03:04.018578 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.018514    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-853a1b3f-dockercfg-z4rb7\""
Jul 28 13:03:04.029059 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.029032    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"]
Jul 28 13:03:04.060996 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.060950    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"]
Jul 28 13:03:04.063309 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.063293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:04.074590 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.074557    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"]
Jul 28 13:03:04.209689 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.209655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c3a5767-ea7f-4705-a381-bc9091f63851-plugins-config-volume\") pod \"payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268\" (UID: \"4c3a5767-ea7f-4705-a381-bc9091f63851\") " pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:04.209888 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.209710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9650324-9a08-4440-9b82-0e8c0a73d0b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75\" (UID: \"d9650324-9a08-4440-9b82-0e8c0a73d0b1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:04.209888 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.209806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phlnj\" (UniqueName: \"kubernetes.io/projected/4c3a5767-ea7f-4705-a381-bc9091f63851-kube-api-access-phlnj\") pod \"payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268\" (UID: \"4c3a5767-ea7f-4705-a381-bc9091f63851\") " pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:04.209888 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.209867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt8l5\" (UniqueName: \"kubernetes.io/projected/d9650324-9a08-4440-9b82-0e8c0a73d0b1-kube-api-access-gt8l5\") pod \"payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75\" (UID: \"d9650324-9a08-4440-9b82-0e8c0a73d0b1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:04.311392 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.311355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c3a5767-ea7f-4705-a381-bc9091f63851-plugins-config-volume\") pod \"payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268\" (UID: \"4c3a5767-ea7f-4705-a381-bc9091f63851\") " pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:04.311570 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.311410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9650324-9a08-4440-9b82-0e8c0a73d0b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75\" (UID: \"d9650324-9a08-4440-9b82-0e8c0a73d0b1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:04.311570 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.311454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phlnj\" (UniqueName: \"kubernetes.io/projected/4c3a5767-ea7f-4705-a381-bc9091f63851-kube-api-access-phlnj\") pod \"payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268\" (UID: \"4c3a5767-ea7f-4705-a381-bc9091f63851\") " pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:04.311570 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.311496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt8l5\" (UniqueName: \"kubernetes.io/projected/d9650324-9a08-4440-9b82-0e8c0a73d0b1-kube-api-access-gt8l5\") pod \"payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75\" (UID: \"d9650324-9a08-4440-9b82-0e8c0a73d0b1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:04.312253 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.312232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9650324-9a08-4440-9b82-0e8c0a73d0b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75\" (UID: \"d9650324-9a08-4440-9b82-0e8c0a73d0b1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:04.312294 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.312235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c3a5767-ea7f-4705-a381-bc9091f63851-plugins-config-volume\") pod \"payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268\" (UID: \"4c3a5767-ea7f-4705-a381-bc9091f63851\") " pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:04.319396 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.319368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt8l5\" (UniqueName: \"kubernetes.io/projected/d9650324-9a08-4440-9b82-0e8c0a73d0b1-kube-api-access-gt8l5\") pod \"payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75\" (UID: \"d9650324-9a08-4440-9b82-0e8c0a73d0b1\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:04.319544 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.319502    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phlnj\" (UniqueName: \"kubernetes.io/projected/4c3a5767-ea7f-4705-a381-bc9091f63851-kube-api-access-phlnj\") pod \"payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268\" (UID: \"4c3a5767-ea7f-4705-a381-bc9091f63851\") " pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:04.329198 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.329170    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:04.374934 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.374896    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:04.484575 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.484549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"]
Jul 28 13:03:04.487640 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:03:04.487598    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c3a5767_ea7f_4705_a381_bc9091f63851.slice/crio-907e3c953d17edfbb2dd15393c5c4b7127923f760bc78aa63fb39a4fce12095b WatchSource:0}: Error finding container 907e3c953d17edfbb2dd15393c5c4b7127923f760bc78aa63fb39a4fce12095b: Status 404 returned error can't find the container with id 907e3c953d17edfbb2dd15393c5c4b7127923f760bc78aa63fb39a4fce12095b
Jul 28 13:03:04.543970 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.543943    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"]
Jul 28 13:03:04.546225 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:03:04.546194    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9650324_9a08_4440_9b82_0e8c0a73d0b1.slice/crio-335f2b7f6eb6029d28d01c60f094a65abc6b29d6864092d2fd433dc582d0b1fe WatchSource:0}: Error finding container 335f2b7f6eb6029d28d01c60f094a65abc6b29d6864092d2fd433dc582d0b1fe: Status 404 returned error can't find the container with id 335f2b7f6eb6029d28d01c60f094a65abc6b29d6864092d2fd433dc582d0b1fe
Jul 28 13:03:04.591002 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.590948    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268" event={"ID":"4c3a5767-ea7f-4705-a381-bc9091f63851","Type":"ContainerStarted","Data":"907e3c953d17edfbb2dd15393c5c4b7127923f760bc78aa63fb39a4fce12095b"}
Jul 28 13:03:04.592057 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.592033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75" event={"ID":"d9650324-9a08-4440-9b82-0e8c0a73d0b1","Type":"ContainerStarted","Data":"335f2b7f6eb6029d28d01c60f094a65abc6b29d6864092d2fd433dc582d0b1fe"}
Jul 28 13:03:04.787205 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.787180    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:03:04.816746 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.816716    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istiod-ca-cert\") pod \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") "
Jul 28 13:03:04.816950 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.816766    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-socket\") pod \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") "
Jul 28 13:03:04.816950 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.816800    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-token\") pod \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") "
Jul 28 13:03:04.816950 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.816850    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-data\") pod \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") "
Jul 28 13:03:04.816950 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.816880    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-envoy\") pod \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") "
Jul 28 13:03:04.816950 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.816908    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-credential-socket\") pod \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") "
Jul 28 13:03:04.817242 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.816952    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpgbx\" (UniqueName: \"kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-kube-api-access-mpgbx\") pod \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") "
Jul 28 13:03:04.817242 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.817017    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-podinfo\") pod \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") "
Jul 28 13:03:04.817242 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.817046    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-certs\") pod \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\" (UID: \"21164a08-1a17-4d03-b78f-d7ea4a9ae08b\") "
Jul 28 13:03:04.817453 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.817226    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "21164a08-1a17-4d03-b78f-d7ea4a9ae08b" (UID: "21164a08-1a17-4d03-b78f-d7ea4a9ae08b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:03:04.817453 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.817426    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "21164a08-1a17-4d03-b78f-d7ea4a9ae08b" (UID: "21164a08-1a17-4d03-b78f-d7ea4a9ae08b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:03:04.817562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.817451    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:04.817562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.817493    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "21164a08-1a17-4d03-b78f-d7ea4a9ae08b" (UID: "21164a08-1a17-4d03-b78f-d7ea4a9ae08b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:03:04.817562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.817498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "21164a08-1a17-4d03-b78f-d7ea4a9ae08b" (UID: "21164a08-1a17-4d03-b78f-d7ea4a9ae08b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:03:04.817796 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.817776    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-data" (OuterVolumeSpecName: "istio-data") pod "21164a08-1a17-4d03-b78f-d7ea4a9ae08b" (UID: "21164a08-1a17-4d03-b78f-d7ea4a9ae08b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:03:04.819676 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.819644    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "21164a08-1a17-4d03-b78f-d7ea4a9ae08b" (UID: "21164a08-1a17-4d03-b78f-d7ea4a9ae08b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:03:04.819808 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.819750    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "21164a08-1a17-4d03-b78f-d7ea4a9ae08b" (UID: "21164a08-1a17-4d03-b78f-d7ea4a9ae08b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:03:04.820003 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.819957    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-token" (OuterVolumeSpecName: "istio-token") pod "21164a08-1a17-4d03-b78f-d7ea4a9ae08b" (UID: "21164a08-1a17-4d03-b78f-d7ea4a9ae08b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:03:04.820003 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.819958    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-kube-api-access-mpgbx" (OuterVolumeSpecName: "kube-api-access-mpgbx") pod "21164a08-1a17-4d03-b78f-d7ea4a9ae08b" (UID: "21164a08-1a17-4d03-b78f-d7ea4a9ae08b"). InnerVolumeSpecName "kube-api-access-mpgbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:03:04.918201 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.918156    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:04.918201 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.918196    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:04.918201 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.918210    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:04.918502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.918223    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:04.918502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.918236    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:04.918502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.918250    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpgbx\" (UniqueName: \"kubernetes.io/projected/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-kube-api-access-mpgbx\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:04.918502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.918263    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:04.918502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:04.918276    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21164a08-1a17-4d03-b78f-d7ea4a9ae08b-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:05.599448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.599056    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268" event={"ID":"4c3a5767-ea7f-4705-a381-bc9091f63851","Type":"ContainerStarted","Data":"5f7250601214d493e0de07577ae06a5192c54b52042032e7b7feb34057748213"}
Jul 28 13:03:05.599448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.599135    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:05.600762 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.600733    2565 generic.go:356] "Generic (PLEG): container finished" podID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerID="bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b" exitCode=0
Jul 28 13:03:05.600920 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.600791    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"
Jul 28 13:03:05.600920 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.600813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" event={"ID":"21164a08-1a17-4d03-b78f-d7ea4a9ae08b","Type":"ContainerDied","Data":"bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b"}
Jul 28 13:03:05.600920 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.600862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j" event={"ID":"21164a08-1a17-4d03-b78f-d7ea4a9ae08b","Type":"ContainerDied","Data":"a83625b8c1744d9acd868544d5d864c2b23a6e00d64b130c16b95dd01913cb02"}
Jul 28 13:03:05.600920 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.600892    2565 scope.go:117] "RemoveContainer" containerID="bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b"
Jul 28 13:03:05.602617 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.602596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75" event={"ID":"d9650324-9a08-4440-9b82-0e8c0a73d0b1","Type":"ContainerStarted","Data":"6512efded5eecdf4f6d425525e3aa484c222b3afff65e1be5d3cbfc9dea3ee93"}
Jul 28 13:03:05.609971 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.609948    2565 scope.go:117] "RemoveContainer" containerID="cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b"
Jul 28 13:03:05.616447 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.616399    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268" podStartSLOduration=2.616382566 podStartE2EDuration="2.616382566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:03:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:03:05.61415488 +0000 UTC m=+1994.224020589" watchObservedRunningTime="2026-07-28 13:03:05.616382566 +0000 UTC m=+1994.226248359"
Jul 28 13:03:05.619940 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.619921    2565 scope.go:117] "RemoveContainer" containerID="bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b"
Jul 28 13:03:05.620312 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:03:05.620287    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b\": container with ID starting with bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b not found: ID does not exist" containerID="bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b"
Jul 28 13:03:05.620381 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.620324    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b"} err="failed to get container status \"bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b\": rpc error: code = NotFound desc = could not find container \"bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b\": container with ID starting with bfb58549f1454871ae9826adb667034dd947457e0de724e7f779aca68101dd6b not found: ID does not exist"
Jul 28 13:03:05.620381 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.620347    2565 scope.go:117] "RemoveContainer" containerID="cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b"
Jul 28 13:03:05.620618 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:03:05.620600    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b\": container with ID starting with cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b not found: ID does not exist" containerID="cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b"
Jul 28 13:03:05.620679 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.620629    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b"} err="failed to get container status \"cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b\": rpc error: code = NotFound desc = could not find container \"cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b\": container with ID starting with cde9d329e222741badcfc494acd91371eab63dbeeca84a61e2ee74e4fc6e190b not found: ID does not exist"
Jul 28 13:03:05.630263 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.630215    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75" podStartSLOduration=1.6301996189999999 podStartE2EDuration="1.630199619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:03:05.628374885 +0000 UTC m=+1994.238240593" watchObservedRunningTime="2026-07-28 13:03:05.630199619 +0000 UTC m=+1994.240065327"
Jul 28 13:03:05.642186 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.642138    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"]
Jul 28 13:03:05.646869 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.646841    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d3416997-openshift-default-6644d8b986-kvd7j"]
Jul 28 13:03:05.901300 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:05.901222    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" path="/var/lib/kubelet/pods/21164a08-1a17-4d03-b78f-d7ea4a9ae08b/volumes"
Jul 28 13:03:06.608552 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:06.608515    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:16.610347 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:16.610309    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:17.616401 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:17.616366    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:17.670645 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:17.670602    2565 generic.go:356] "Generic (PLEG): container finished" podID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerID="d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1" exitCode=0
Jul 28 13:03:17.670826 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:17.670667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" event={"ID":"f3d6c021-950f-4686-8b16-c6c18dd721ce","Type":"ContainerDied","Data":"d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1"}
Jul 28 13:03:17.671122 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:17.671108    2565 scope.go:117] "RemoveContainer" containerID="d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1"
Jul 28 13:03:17.672223 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:17.672197    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:03:17.672303 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:17.672271    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:03:17.672348 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:17.672305    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:03:18.585146 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:18.585101    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:18.678257 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:18.678220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" event={"ID":"f3d6c021-950f-4686-8b16-c6c18dd721ce","Type":"ContainerStarted","Data":"caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf"}
Jul 28 13:03:18.977758 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:18.977719    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:18.979472 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:18.979108    2565 patch_prober.go:28] interesting pod/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 28 13:03:18.979472 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:18.979183    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 28 13:03:19.978036 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:19.977968    2565 patch_prober.go:28] interesting pod/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 28 13:03:19.978456 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:19.978061    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 28 13:03:20.977494 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:20.977452    2565 patch_prober.go:28] interesting pod/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 28 13:03:20.977684 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:20.977522    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 28 13:03:21.977652 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:21.977614    2565 patch_prober.go:28] interesting pod/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 28 13:03:21.978094 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:21.977675    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 28 13:03:22.982698 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:22.982666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:22.983201 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:22.982940    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:22.983707 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:22.983687    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:38.558172 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.558130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:38.584568 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.584528    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"]
Jul 28 13:03:38.584893 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.584858    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268" podUID="4c3a5767-ea7f-4705-a381-bc9091f63851" containerName="payload-processing" containerID="cri-o://5f7250601214d493e0de07577ae06a5192c54b52042032e7b7feb34057748213" gracePeriod=30
Jul 28 13:03:38.597796 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.597761    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"]
Jul 28 13:03:38.598366 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.598104    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75" podUID="d9650324-9a08-4440-9b82-0e8c0a73d0b1" containerName="payload-pre-processing" containerID="cri-o://6512efded5eecdf4f6d425525e3aa484c222b3afff65e1be5d3cbfc9dea3ee93" gracePeriod=30
Jul 28 13:03:38.629963 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.629928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:38.693726 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.693683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:38.797635 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.796518    2565 generic.go:356] "Generic (PLEG): container finished" podID="4c3a5767-ea7f-4705-a381-bc9091f63851" containerID="5f7250601214d493e0de07577ae06a5192c54b52042032e7b7feb34057748213" exitCode=0
Jul 28 13:03:38.797635 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.796590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268" event={"ID":"4c3a5767-ea7f-4705-a381-bc9091f63851","Type":"ContainerDied","Data":"5f7250601214d493e0de07577ae06a5192c54b52042032e7b7feb34057748213"}
Jul 28 13:03:38.798703 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.798630    2565 generic.go:356] "Generic (PLEG): container finished" podID="d9650324-9a08-4440-9b82-0e8c0a73d0b1" containerID="6512efded5eecdf4f6d425525e3aa484c222b3afff65e1be5d3cbfc9dea3ee93" exitCode=0
Jul 28 13:03:38.798703 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.798667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75" event={"ID":"d9650324-9a08-4440-9b82-0e8c0a73d0b1","Type":"ContainerDied","Data":"6512efded5eecdf4f6d425525e3aa484c222b3afff65e1be5d3cbfc9dea3ee93"}
Jul 28 13:03:38.861884 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.861853    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:38.894953 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.894919    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:38.959756 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.959719    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phlnj\" (UniqueName: \"kubernetes.io/projected/4c3a5767-ea7f-4705-a381-bc9091f63851-kube-api-access-phlnj\") pod \"4c3a5767-ea7f-4705-a381-bc9091f63851\" (UID: \"4c3a5767-ea7f-4705-a381-bc9091f63851\") "
Jul 28 13:03:38.959953 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.959788    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c3a5767-ea7f-4705-a381-bc9091f63851-plugins-config-volume\") pod \"4c3a5767-ea7f-4705-a381-bc9091f63851\" (UID: \"4c3a5767-ea7f-4705-a381-bc9091f63851\") "
Jul 28 13:03:38.960273 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.960244    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c3a5767-ea7f-4705-a381-bc9091f63851-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4c3a5767-ea7f-4705-a381-bc9091f63851" (UID: "4c3a5767-ea7f-4705-a381-bc9091f63851"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:03:38.962238 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:38.962204    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c3a5767-ea7f-4705-a381-bc9091f63851-kube-api-access-phlnj" (OuterVolumeSpecName: "kube-api-access-phlnj") pod "4c3a5767-ea7f-4705-a381-bc9091f63851" (UID: "4c3a5767-ea7f-4705-a381-bc9091f63851"). InnerVolumeSpecName "kube-api-access-phlnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:03:39.061271 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.061235    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt8l5\" (UniqueName: \"kubernetes.io/projected/d9650324-9a08-4440-9b82-0e8c0a73d0b1-kube-api-access-gt8l5\") pod \"d9650324-9a08-4440-9b82-0e8c0a73d0b1\" (UID: \"d9650324-9a08-4440-9b82-0e8c0a73d0b1\") "
Jul 28 13:03:39.061455 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.061318    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9650324-9a08-4440-9b82-0e8c0a73d0b1-plugins-config-volume\") pod \"d9650324-9a08-4440-9b82-0e8c0a73d0b1\" (UID: \"d9650324-9a08-4440-9b82-0e8c0a73d0b1\") "
Jul 28 13:03:39.061676 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.061656    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phlnj\" (UniqueName: \"kubernetes.io/projected/4c3a5767-ea7f-4705-a381-bc9091f63851-kube-api-access-phlnj\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:39.061719 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.061684    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4c3a5767-ea7f-4705-a381-bc9091f63851-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:39.061719 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.061683    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9650324-9a08-4440-9b82-0e8c0a73d0b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d9650324-9a08-4440-9b82-0e8c0a73d0b1" (UID: "d9650324-9a08-4440-9b82-0e8c0a73d0b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:03:39.063618 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.063589    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9650324-9a08-4440-9b82-0e8c0a73d0b1-kube-api-access-gt8l5" (OuterVolumeSpecName: "kube-api-access-gt8l5") pod "d9650324-9a08-4440-9b82-0e8c0a73d0b1" (UID: "d9650324-9a08-4440-9b82-0e8c0a73d0b1"). InnerVolumeSpecName "kube-api-access-gt8l5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:03:39.162308 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.162200    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt8l5\" (UniqueName: \"kubernetes.io/projected/d9650324-9a08-4440-9b82-0e8c0a73d0b1-kube-api-access-gt8l5\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:39.162308 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.162240    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d9650324-9a08-4440-9b82-0e8c0a73d0b1-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:39.805027 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.804994    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"
Jul 28 13:03:39.805506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.805027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75" event={"ID":"d9650324-9a08-4440-9b82-0e8c0a73d0b1","Type":"ContainerDied","Data":"335f2b7f6eb6029d28d01c60f094a65abc6b29d6864092d2fd433dc582d0b1fe"}
Jul 28 13:03:39.805506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.805090    2565 scope.go:117] "RemoveContainer" containerID="6512efded5eecdf4f6d425525e3aa484c222b3afff65e1be5d3cbfc9dea3ee93"
Jul 28 13:03:39.806549 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.806485    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268" event={"ID":"4c3a5767-ea7f-4705-a381-bc9091f63851","Type":"ContainerDied","Data":"907e3c953d17edfbb2dd15393c5c4b7127923f760bc78aa63fb39a4fce12095b"}
Jul 28 13:03:39.806549 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.806514    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"
Jul 28 13:03:39.815405 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.815384    2565 scope.go:117] "RemoveContainer" containerID="5f7250601214d493e0de07577ae06a5192c54b52042032e7b7feb34057748213"
Jul 28 13:03:39.831326 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.831294    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"]
Jul 28 13:03:39.835536 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.835501    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-853a1b3f-84c7f668d9-ds268"]
Jul 28 13:03:39.847174 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.847134    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"]
Jul 28 13:03:39.850766 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.850736    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-853a1b3f-649bcc96f6-zqc75"]
Jul 28 13:03:39.900034 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.899919    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c3a5767-ea7f-4705-a381-bc9091f63851" path="/var/lib/kubelet/pods/4c3a5767-ea7f-4705-a381-bc9091f63851/volumes"
Jul 28 13:03:39.900382 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:39.900360    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9650324-9a08-4440-9b82-0e8c0a73d0b1" path="/var/lib/kubelet/pods/d9650324-9a08-4440-9b82-0e8c0a73d0b1/volumes"
Jul 28 13:03:43.190526 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:43.190494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:43.319933 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:43.319894    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"]
Jul 28 13:03:43.320246 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:43.320198    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy" containerID="cri-o://caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf" gracePeriod=30
Jul 28 13:03:43.337429 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:43.337385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:43.573293 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:43.573264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:43.793203 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:43.793165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:44.084534 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.084496    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"]
Jul 28 13:03:44.084928 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.084911    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy"
Jul 28 13:03:44.085045 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.084931    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy"
Jul 28 13:03:44.085045 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.084952    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c3a5767-ea7f-4705-a381-bc9091f63851" containerName="payload-processing"
Jul 28 13:03:44.085045 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.084961    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c3a5767-ea7f-4705-a381-bc9091f63851" containerName="payload-processing"
Jul 28 13:03:44.085045 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.085030    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9650324-9a08-4440-9b82-0e8c0a73d0b1" containerName="payload-pre-processing"
Jul 28 13:03:44.085045 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.085040    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9650324-9a08-4440-9b82-0e8c0a73d0b1" containerName="payload-pre-processing"
Jul 28 13:03:44.085332 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.085051    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy"
Jul 28 13:03:44.085332 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.085061    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy"
Jul 28 13:03:44.085332 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.085194    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9650324-9a08-4440-9b82-0e8c0a73d0b1" containerName="payload-pre-processing"
Jul 28 13:03:44.085332 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.085209    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c3a5767-ea7f-4705-a381-bc9091f63851" containerName="payload-processing"
Jul 28 13:03:44.085332 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.085221    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy"
Jul 28 13:03:44.085332 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.085232    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="21164a08-1a17-4d03-b78f-d7ea4a9ae08b" containerName="istio-proxy"
Jul 28 13:03:44.088122 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.088101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.090231 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.090203    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ce27c48c-openshift-default-dockercfg-6frfv\""
Jul 28 13:03:44.101308 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.101287    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"]
Jul 28 13:03:44.104660 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.104636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-socket\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.104768 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.104691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522f2c58-680d-4670-9028-892a54bd2e25-istio-podinfo\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.104768 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.104725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-istio-token\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.104866 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.104766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522f2c58-680d-4670-9028-892a54bd2e25-istiod-ca-cert\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.104866 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.104850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82r8b\" (UniqueName: \"kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-kube-api-access-82r8b\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.104941 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.104902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-data\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.105006 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.104961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-credential-socket\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.105043 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.105016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-envoy\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.105091 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.105043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-certs\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.110450 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.110428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:44.206037 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82r8b\" (UniqueName: \"kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-kube-api-access-82r8b\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-data\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206090    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-credential-socket\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-envoy\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-certs\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-socket\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522f2c58-680d-4670-9028-892a54bd2e25-istio-podinfo\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-istio-token\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206274    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522f2c58-680d-4670-9028-892a54bd2e25-istiod-ca-cert\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206933 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-credential-socket\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206933 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-data\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206933 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-certs\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.206933 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.206900    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-socket\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.207122 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.207105    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522f2c58-680d-4670-9028-892a54bd2e25-istiod-ca-cert\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.208806 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.208785    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-envoy\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.209052 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.209033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522f2c58-680d-4670-9028-892a54bd2e25-istio-podinfo\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.213558 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.213533    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-istio-token\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.213807 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.213786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82r8b\" (UniqueName: \"kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-kube-api-access-82r8b\") pod \"e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") " pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.398843 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.398742    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:44.553795 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.553768    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"]
Jul 28 13:03:44.556762 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:03:44.556724    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522f2c58_680d_4670_9028_892a54bd2e25.slice/crio-d19308cfda90939904aef836859e1db71b4f3da3d59a4abbecb4d43ef7848ca6 WatchSource:0}: Error finding container d19308cfda90939904aef836859e1db71b4f3da3d59a4abbecb4d43ef7848ca6: Status 404 returned error can't find the container with id d19308cfda90939904aef836859e1db71b4f3da3d59a4abbecb4d43ef7848ca6
Jul 28 13:03:44.559552 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.559507    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:03:44.559665 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.559617    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:03:44.559665 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.559659    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:03:44.834424 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.834369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:44.840167 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.840133    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" event={"ID":"522f2c58-680d-4670-9028-892a54bd2e25","Type":"ContainerStarted","Data":"534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a"}
Jul 28 13:03:44.840390 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.840190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" event={"ID":"522f2c58-680d-4670-9028-892a54bd2e25","Type":"ContainerStarted","Data":"d19308cfda90939904aef836859e1db71b4f3da3d59a4abbecb4d43ef7848ca6"}
Jul 28 13:03:44.860870 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:44.860807    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" podStartSLOduration=0.860785584 podStartE2EDuration="860.785584ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:03:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:03:44.860137976 +0000 UTC m=+2033.470003698" watchObservedRunningTime="2026-07-28 13:03:44.860785584 +0000 UTC m=+2033.470651293"
Jul 28 13:03:45.399154 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:45.399109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:45.404562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:45.404530    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:45.845645 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:45.845605    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:45.846774 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:45.846747    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:03:46.203624 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:46.203592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:46.309175 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:46.309142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:46.421914 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:46.421869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:46.526327 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:46.526229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:46.910464 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:46.910373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:47.015171 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.015130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:47.039054 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.039014    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"]
Jul 28 13:03:47.041511 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.041482    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:03:47.043638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.043615    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ce27c48c-dockercfg-wgbqt\""
Jul 28 13:03:47.043876 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.043862    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ce27c48c\""
Jul 28 13:03:47.051214 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.051179    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"]
Jul 28 13:03:47.054209 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.054176    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:03:47.071019 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.069840    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"]
Jul 28 13:03:47.095097 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.095066    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"]
Jul 28 13:03:47.137133 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.137075    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cb151fc-2e9d-43c0-b139-c9460d98b39a-plugins-config-volume\") pod \"payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz\" (UID: \"5cb151fc-2e9d-43c0-b139-c9460d98b39a\") " pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:03:47.137359 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.137223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln65x\" (UniqueName: \"kubernetes.io/projected/c53ac380-c7da-4acb-8c06-31359ecf412f-kube-api-access-ln65x\") pod \"payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r\" (UID: \"c53ac380-c7da-4acb-8c06-31359ecf412f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:03:47.137359 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.137273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5mp2\" (UniqueName: \"kubernetes.io/projected/5cb151fc-2e9d-43c0-b139-c9460d98b39a-kube-api-access-j5mp2\") pod \"payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz\" (UID: \"5cb151fc-2e9d-43c0-b139-c9460d98b39a\") " pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:03:47.137469 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.137370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c53ac380-c7da-4acb-8c06-31359ecf412f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r\" (UID: \"c53ac380-c7da-4acb-8c06-31359ecf412f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:03:47.238488 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.238442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cb151fc-2e9d-43c0-b139-c9460d98b39a-plugins-config-volume\") pod \"payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz\" (UID: \"5cb151fc-2e9d-43c0-b139-c9460d98b39a\") " pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:03:47.238488 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.238501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln65x\" (UniqueName: \"kubernetes.io/projected/c53ac380-c7da-4acb-8c06-31359ecf412f-kube-api-access-ln65x\") pod \"payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r\" (UID: \"c53ac380-c7da-4acb-8c06-31359ecf412f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:03:47.238796 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.238523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5mp2\" (UniqueName: \"kubernetes.io/projected/5cb151fc-2e9d-43c0-b139-c9460d98b39a-kube-api-access-j5mp2\") pod \"payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz\" (UID: \"5cb151fc-2e9d-43c0-b139-c9460d98b39a\") " pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:03:47.238796 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.238550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c53ac380-c7da-4acb-8c06-31359ecf412f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r\" (UID: \"c53ac380-c7da-4acb-8c06-31359ecf412f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:03:47.239298 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.239265    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cb151fc-2e9d-43c0-b139-c9460d98b39a-plugins-config-volume\") pod \"payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz\" (UID: \"5cb151fc-2e9d-43c0-b139-c9460d98b39a\") " pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:03:47.239385 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.239315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c53ac380-c7da-4acb-8c06-31359ecf412f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r\" (UID: \"c53ac380-c7da-4acb-8c06-31359ecf412f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:03:47.247998 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.247956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln65x\" (UniqueName: \"kubernetes.io/projected/c53ac380-c7da-4acb-8c06-31359ecf412f-kube-api-access-ln65x\") pod \"payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r\" (UID: \"c53ac380-c7da-4acb-8c06-31359ecf412f\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:03:47.248115 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.247959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5mp2\" (UniqueName: \"kubernetes.io/projected/5cb151fc-2e9d-43c0-b139-c9460d98b39a-kube-api-access-j5mp2\") pod \"payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz\" (UID: \"5cb151fc-2e9d-43c0-b139-c9460d98b39a\") " pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:03:47.355153 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.355106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:03:47.371274 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.371241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:03:47.533315 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.532837    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"]
Jul 28 13:03:47.535796 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:03:47.535754    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53ac380_c7da_4acb_8c06_31359ecf412f.slice/crio-69da97d362c8f7bed5b2b884b8dfc9fe32c730cc902f46acd45ae810738f476b WatchSource:0}: Error finding container 69da97d362c8f7bed5b2b884b8dfc9fe32c730cc902f46acd45ae810738f476b: Status 404 returned error can't find the container with id 69da97d362c8f7bed5b2b884b8dfc9fe32c730cc902f46acd45ae810738f476b
Jul 28 13:03:47.564199 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.564173    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"]
Jul 28 13:03:47.575415 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:03:47.575371    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb151fc_2e9d_43c0_b139_c9460d98b39a.slice/crio-a91e425037d4ffaca0866979b510d270c09cb02ac6b82625a556838b1e17f9c3 WatchSource:0}: Error finding container a91e425037d4ffaca0866979b510d270c09cb02ac6b82625a556838b1e17f9c3: Status 404 returned error can't find the container with id a91e425037d4ffaca0866979b510d270c09cb02ac6b82625a556838b1e17f9c3
Jul 28 13:03:47.860188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.860080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r" event={"ID":"c53ac380-c7da-4acb-8c06-31359ecf412f","Type":"ContainerStarted","Data":"9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8"}
Jul 28 13:03:47.860188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.860150    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r" event={"ID":"c53ac380-c7da-4acb-8c06-31359ecf412f","Type":"ContainerStarted","Data":"69da97d362c8f7bed5b2b884b8dfc9fe32c730cc902f46acd45ae810738f476b"}
Jul 28 13:03:47.860188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.860184    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:03:47.861727 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.861700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz" event={"ID":"5cb151fc-2e9d-43c0-b139-c9460d98b39a","Type":"ContainerStarted","Data":"423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9"}
Jul 28 13:03:47.861846 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.861745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz" event={"ID":"5cb151fc-2e9d-43c0-b139-c9460d98b39a","Type":"ContainerStarted","Data":"a91e425037d4ffaca0866979b510d270c09cb02ac6b82625a556838b1e17f9c3"}
Jul 28 13:03:47.882821 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.882748    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r" podStartSLOduration=0.882724813 podStartE2EDuration="882.724813ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:03:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:03:47.880674753 +0000 UTC m=+2036.490540465" watchObservedRunningTime="2026-07-28 13:03:47.882724813 +0000 UTC m=+2036.492590523"
Jul 28 13:03:47.897346 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:47.897285    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz" podStartSLOduration=0.89726249 podStartE2EDuration="897.26249ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:03:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:03:47.896251985 +0000 UTC m=+2036.506117695" watchObservedRunningTime="2026-07-28 13:03:47.89726249 +0000 UTC m=+2036.507128198"
Jul 28 13:03:48.587911 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.587835    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:48.651512 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-envoy\") pod \"f3d6c021-950f-4686-8b16-c6c18dd721ce\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") "
Jul 28 13:03:48.651512 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651509    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-socket\") pod \"f3d6c021-950f-4686-8b16-c6c18dd721ce\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") "
Jul 28 13:03:48.651791 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651597    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3d6c021-950f-4686-8b16-c6c18dd721ce-istiod-ca-cert\") pod \"f3d6c021-950f-4686-8b16-c6c18dd721ce\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") "
Jul 28 13:03:48.651791 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlq5m\" (UniqueName: \"kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-kube-api-access-hlq5m\") pod \"f3d6c021-950f-4686-8b16-c6c18dd721ce\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") "
Jul 28 13:03:48.651791 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651652    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-credential-socket\") pod \"f3d6c021-950f-4686-8b16-c6c18dd721ce\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") "
Jul 28 13:03:48.651791 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651769    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-data\") pod \"f3d6c021-950f-4686-8b16-c6c18dd721ce\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") "
Jul 28 13:03:48.652056 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651814    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-token\") pod \"f3d6c021-950f-4686-8b16-c6c18dd721ce\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") "
Jul 28 13:03:48.652056 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651825    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f3d6c021-950f-4686-8b16-c6c18dd721ce" (UID: "f3d6c021-950f-4686-8b16-c6c18dd721ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:03:48.652056 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651889    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-podinfo\") pod \"f3d6c021-950f-4686-8b16-c6c18dd721ce\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") "
Jul 28 13:03:48.652056 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651934    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-certs\") pod \"f3d6c021-950f-4686-8b16-c6c18dd721ce\" (UID: \"f3d6c021-950f-4686-8b16-c6c18dd721ce\") "
Jul 28 13:03:48.652056 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.651949    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f3d6c021-950f-4686-8b16-c6c18dd721ce" (UID: "f3d6c021-950f-4686-8b16-c6c18dd721ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:03:48.652307 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.652122    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3d6c021-950f-4686-8b16-c6c18dd721ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f3d6c021-950f-4686-8b16-c6c18dd721ce" (UID: "f3d6c021-950f-4686-8b16-c6c18dd721ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:03:48.652362 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.652298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f3d6c021-950f-4686-8b16-c6c18dd721ce" (UID: "f3d6c021-950f-4686-8b16-c6c18dd721ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:03:48.652418 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.652405    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:48.652492 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.652477    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:48.652619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.652558    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f3d6c021-950f-4686-8b16-c6c18dd721ce-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:48.652662 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.652624    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:48.653068 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.653041    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "f3d6c021-950f-4686-8b16-c6c18dd721ce" (UID: "f3d6c021-950f-4686-8b16-c6c18dd721ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:03:48.654154 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.654119    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f3d6c021-950f-4686-8b16-c6c18dd721ce" (UID: "f3d6c021-950f-4686-8b16-c6c18dd721ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:03:48.654285 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.654215    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "f3d6c021-950f-4686-8b16-c6c18dd721ce" (UID: "f3d6c021-950f-4686-8b16-c6c18dd721ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:03:48.654679 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.654655    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f3d6c021-950f-4686-8b16-c6c18dd721ce" (UID: "f3d6c021-950f-4686-8b16-c6c18dd721ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:03:48.654679 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.654658    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-kube-api-access-hlq5m" (OuterVolumeSpecName: "kube-api-access-hlq5m") pod "f3d6c021-950f-4686-8b16-c6c18dd721ce" (UID: "f3d6c021-950f-4686-8b16-c6c18dd721ce"). InnerVolumeSpecName "kube-api-access-hlq5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:03:48.753180 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.753145    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlq5m\" (UniqueName: \"kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-kube-api-access-hlq5m\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:48.753180 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.753179    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:48.753180 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.753188    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:48.753446 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.753198    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:48.753446 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.753211    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f3d6c021-950f-4686-8b16-c6c18dd721ce-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:03:48.868811 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.868717    2565 generic.go:356] "Generic (PLEG): container finished" podID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerID="caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf" exitCode=0
Jul 28 13:03:48.868811 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.868768    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"
Jul 28 13:03:48.868811 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.868799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" event={"ID":"f3d6c021-950f-4686-8b16-c6c18dd721ce","Type":"ContainerDied","Data":"caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf"}
Jul 28 13:03:48.869143 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.868857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4" event={"ID":"f3d6c021-950f-4686-8b16-c6c18dd721ce","Type":"ContainerDied","Data":"9af02beb5171a010d74a42f2706273cdfd9a9582406062ebd23eb608b68ee78c"}
Jul 28 13:03:48.869143 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.868879    2565 scope.go:117] "RemoveContainer" containerID="caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf"
Jul 28 13:03:48.869251 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.869153    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:03:48.878764 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.878742    2565 scope.go:117] "RemoveContainer" containerID="d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1"
Jul 28 13:03:48.888917 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.888895    2565 scope.go:117] "RemoveContainer" containerID="caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf"
Jul 28 13:03:48.889327 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:03:48.889302    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf\": container with ID starting with caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf not found: ID does not exist" containerID="caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf"
Jul 28 13:03:48.889422 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.889337    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf"} err="failed to get container status \"caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf\": rpc error: code = NotFound desc = could not find container \"caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf\": container with ID starting with caf80fb14d98cd25cc7d3ed51d9ec37c9a79cb399dc356a2fa607f758ca19bdf not found: ID does not exist"
Jul 28 13:03:48.889422 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.889356    2565 scope.go:117] "RemoveContainer" containerID="d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1"
Jul 28 13:03:48.889673 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:03:48.889653    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1\": container with ID starting with d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1 not found: ID does not exist" containerID="d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1"
Jul 28 13:03:48.889752 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.889686    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1"} err="failed to get container status \"d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1\": rpc error: code = NotFound desc = could not find container \"d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1\": container with ID starting with d824a30717e6818ae828eaf91ceddf868177d6232a83d1a276e5260c8636b6b1 not found: ID does not exist"
Jul 28 13:03:48.893366 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.893327    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"]
Jul 28 13:03:48.898914 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:48.898873    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-853a1b3f-gw-openshift-default-67f8dfb944-cxzk4"]
Jul 28 13:03:49.900275 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:49.900240    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" path="/var/lib/kubelet/pods/f3d6c021-950f-4686-8b16-c6c18dd721ce/volumes"
Jul 28 13:03:58.872194 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:58.872158    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:03:59.878238 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:03:59.878205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:04:01.537638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:01.536966    2565 patch_prober.go:28] interesting pod/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:33850->10.132.0.44:15021: read: connection reset by peer" start-of-body=
Jul 28 13:04:01.537638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:01.537069    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": read tcp 10.132.0.2:33850->10.132.0.44:15021: read: connection reset by peer"
Jul 28 13:04:01.944563 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:01.944529    2565 generic.go:356] "Generic (PLEG): container finished" podID="522f2c58-680d-4670-9028-892a54bd2e25" containerID="534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a" exitCode=0
Jul 28 13:04:01.944760 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:01.944618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" event={"ID":"522f2c58-680d-4670-9028-892a54bd2e25","Type":"ContainerDied","Data":"534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a"}
Jul 28 13:04:01.945107 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:01.945091    2565 scope.go:117] "RemoveContainer" containerID="534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a"
Jul 28 13:04:01.948769 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:01.948741    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:04:01.948861 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:01.948830    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:04:01.948921 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:01.948870    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:04:02.951515 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:02.951482    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" event={"ID":"522f2c58-680d-4670-9028-892a54bd2e25","Type":"ContainerStarted","Data":"19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad"}
Jul 28 13:04:03.400316 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:03.400206    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:04:03.400506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:03.400353    2565 patch_prober.go:28] interesting pod/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 28 13:04:03.400506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:03.400399    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 28 13:04:04.400204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:04.400161    2565 patch_prober.go:28] interesting pod/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 28 13:04:04.400864 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:04.400828    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 28 13:04:05.400158 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:05.400105    2565 patch_prober.go:28] interesting pod/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 28 13:04:05.400384 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:05.400211    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 28 13:04:06.399492 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:06.399453    2565 patch_prober.go:28] interesting pod/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 28 13:04:06.399811 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:06.399780    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 28 13:04:06.788112 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:06.788070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:07.403832 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:07.403799    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:04:07.404107 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:07.404086    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:04:07.404808 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:07.404790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:04:22.574510 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:22.574418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:22.607608 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:22.607564    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"]
Jul 28 13:04:22.607856 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:22.607824    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz" podUID="5cb151fc-2e9d-43c0-b139-c9460d98b39a" containerName="payload-processing" containerID="cri-o://423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9" gracePeriod=30
Jul 28 13:04:22.612782 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:22.612745    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"]
Jul 28 13:04:22.613502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:22.613432    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r" podUID="c53ac380-c7da-4acb-8c06-31359ecf412f" containerName="payload-pre-processing" containerID="cri-o://9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8" gracePeriod=30
Jul 28 13:04:22.646115 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:22.646068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:22.743873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:22.743838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:22.912482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:22.912455    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:04:22.915934 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:22.915910    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:04:23.004178 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.004142    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cb151fc-2e9d-43c0-b139-c9460d98b39a-plugins-config-volume\") pod \"5cb151fc-2e9d-43c0-b139-c9460d98b39a\" (UID: \"5cb151fc-2e9d-43c0-b139-c9460d98b39a\") "
Jul 28 13:04:23.004370 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.004200    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c53ac380-c7da-4acb-8c06-31359ecf412f-plugins-config-volume\") pod \"c53ac380-c7da-4acb-8c06-31359ecf412f\" (UID: \"c53ac380-c7da-4acb-8c06-31359ecf412f\") "
Jul 28 13:04:23.004370 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.004287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln65x\" (UniqueName: \"kubernetes.io/projected/c53ac380-c7da-4acb-8c06-31359ecf412f-kube-api-access-ln65x\") pod \"c53ac380-c7da-4acb-8c06-31359ecf412f\" (UID: \"c53ac380-c7da-4acb-8c06-31359ecf412f\") "
Jul 28 13:04:23.004370 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.004320    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5mp2\" (UniqueName: \"kubernetes.io/projected/5cb151fc-2e9d-43c0-b139-c9460d98b39a-kube-api-access-j5mp2\") pod \"5cb151fc-2e9d-43c0-b139-c9460d98b39a\" (UID: \"5cb151fc-2e9d-43c0-b139-c9460d98b39a\") "
Jul 28 13:04:23.004592 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.004571    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cb151fc-2e9d-43c0-b139-c9460d98b39a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5cb151fc-2e9d-43c0-b139-c9460d98b39a" (UID: "5cb151fc-2e9d-43c0-b139-c9460d98b39a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:04:23.004666 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.004641    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c53ac380-c7da-4acb-8c06-31359ecf412f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c53ac380-c7da-4acb-8c06-31359ecf412f" (UID: "c53ac380-c7da-4acb-8c06-31359ecf412f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:04:23.006808 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.006776    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cb151fc-2e9d-43c0-b139-c9460d98b39a-kube-api-access-j5mp2" (OuterVolumeSpecName: "kube-api-access-j5mp2") pod "5cb151fc-2e9d-43c0-b139-c9460d98b39a" (UID: "5cb151fc-2e9d-43c0-b139-c9460d98b39a"). InnerVolumeSpecName "kube-api-access-j5mp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:04:23.006932 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.006781    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c53ac380-c7da-4acb-8c06-31359ecf412f-kube-api-access-ln65x" (OuterVolumeSpecName: "kube-api-access-ln65x") pod "c53ac380-c7da-4acb-8c06-31359ecf412f" (UID: "c53ac380-c7da-4acb-8c06-31359ecf412f"). InnerVolumeSpecName "kube-api-access-ln65x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:04:23.056988 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.056941    2565 generic.go:356] "Generic (PLEG): container finished" podID="5cb151fc-2e9d-43c0-b139-c9460d98b39a" containerID="423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9" exitCode=0
Jul 28 13:04:23.057178 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.057009    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"
Jul 28 13:04:23.057178 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.057031    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz" event={"ID":"5cb151fc-2e9d-43c0-b139-c9460d98b39a","Type":"ContainerDied","Data":"423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9"}
Jul 28 13:04:23.057178 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.057090    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz" event={"ID":"5cb151fc-2e9d-43c0-b139-c9460d98b39a","Type":"ContainerDied","Data":"a91e425037d4ffaca0866979b510d270c09cb02ac6b82625a556838b1e17f9c3"}
Jul 28 13:04:23.057178 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.057115    2565 scope.go:117] "RemoveContainer" containerID="423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9"
Jul 28 13:04:23.058488 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.058462    2565 generic.go:356] "Generic (PLEG): container finished" podID="c53ac380-c7da-4acb-8c06-31359ecf412f" containerID="9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8" exitCode=0
Jul 28 13:04:23.058578 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.058502    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"
Jul 28 13:04:23.058578 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.058526    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r" event={"ID":"c53ac380-c7da-4acb-8c06-31359ecf412f","Type":"ContainerDied","Data":"9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8"}
Jul 28 13:04:23.058578 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.058572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r" event={"ID":"c53ac380-c7da-4acb-8c06-31359ecf412f","Type":"ContainerDied","Data":"69da97d362c8f7bed5b2b884b8dfc9fe32c730cc902f46acd45ae810738f476b"}
Jul 28 13:04:23.067429 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.067400    2565 scope.go:117] "RemoveContainer" containerID="423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9"
Jul 28 13:04:23.067812 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:04:23.067772    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9\": container with ID starting with 423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9 not found: ID does not exist" containerID="423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9"
Jul 28 13:04:23.067929 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.067816    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9"} err="failed to get container status \"423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9\": rpc error: code = NotFound desc = could not find container \"423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9\": container with ID starting with 423b7e883cec4b154711bf70735395b02ad04ebcfdd2bda64059afadd6446ad9 not found: ID does not exist"
Jul 28 13:04:23.067929 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.067844    2565 scope.go:117] "RemoveContainer" containerID="9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8"
Jul 28 13:04:23.077388 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.077368    2565 scope.go:117] "RemoveContainer" containerID="9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8"
Jul 28 13:04:23.077700 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:04:23.077653    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8\": container with ID starting with 9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8 not found: ID does not exist" containerID="9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8"
Jul 28 13:04:23.077700 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.077684    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8"} err="failed to get container status \"9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8\": rpc error: code = NotFound desc = could not find container \"9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8\": container with ID starting with 9bc353aba2b5c6a5d0de4d44cc87902f36b9695df8d490bcb581bac4c3abd1e8 not found: ID does not exist"
Jul 28 13:04:23.080776 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.080746    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"]
Jul 28 13:04:23.084677 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.084649    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ce27c48c-7f976d958d-kbn2r"]
Jul 28 13:04:23.094631 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.094599    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"]
Jul 28 13:04:23.099265 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.099237    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ce27c48c-979fbf74b-bjtfz"]
Jul 28 13:04:23.105392 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.105363    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5cb151fc-2e9d-43c0-b139-c9460d98b39a-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:23.105480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.105395    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c53ac380-c7da-4acb-8c06-31359ecf412f-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:23.105480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.105419    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln65x\" (UniqueName: \"kubernetes.io/projected/c53ac380-c7da-4acb-8c06-31359ecf412f-kube-api-access-ln65x\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:23.105480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.105430    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5mp2\" (UniqueName: \"kubernetes.io/projected/5cb151fc-2e9d-43c0-b139-c9460d98b39a-kube-api-access-j5mp2\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:23.900041 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.899941    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cb151fc-2e9d-43c0-b139-c9460d98b39a" path="/var/lib/kubelet/pods/5cb151fc-2e9d-43c0-b139-c9460d98b39a/volumes"
Jul 28 13:04:23.900403 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:23.900353    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c53ac380-c7da-4acb-8c06-31359ecf412f" path="/var/lib/kubelet/pods/c53ac380-c7da-4acb-8c06-31359ecf412f/volumes"
Jul 28 13:04:27.157911 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:27.157877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:28.356779 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:28.356744    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"]
Jul 28 13:04:28.357252 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:28.356992    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy" containerID="cri-o://19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad" gracePeriod=30
Jul 28 13:04:28.380690 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:28.380659    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:28.620108 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:28.620009    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:28.858400 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:28.858363    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:29.150721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.150688    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"]
Jul 28 13:04:29.151106 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151091    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cb151fc-2e9d-43c0-b139-c9460d98b39a" containerName="payload-processing"
Jul 28 13:04:29.151173 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151110    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cb151fc-2e9d-43c0-b139-c9460d98b39a" containerName="payload-processing"
Jul 28 13:04:29.151173 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151132    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy"
Jul 28 13:04:29.151173 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151138    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy"
Jul 28 13:04:29.151173 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151146    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy"
Jul 28 13:04:29.151173 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151153    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy"
Jul 28 13:04:29.151173 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151160    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c53ac380-c7da-4acb-8c06-31359ecf412f" containerName="payload-pre-processing"
Jul 28 13:04:29.151173 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151165    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c53ac380-c7da-4acb-8c06-31359ecf412f" containerName="payload-pre-processing"
Jul 28 13:04:29.151544 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151221    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy"
Jul 28 13:04:29.151544 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151231    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c53ac380-c7da-4acb-8c06-31359ecf412f" containerName="payload-pre-processing"
Jul 28 13:04:29.151544 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151238    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3d6c021-950f-4686-8b16-c6c18dd721ce" containerName="istio-proxy"
Jul 28 13:04:29.151544 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.151244    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cb151fc-2e9d-43c0-b139-c9460d98b39a" containerName="payload-processing"
Jul 28 13:04:29.154234 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.154216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.156640 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.156615    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bd87d0c9-openshift-default-dockercfg-6c272\""
Jul 28 13:04:29.166332 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.166299    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"]
Jul 28 13:04:29.180267 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.180229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:29.268190 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.268138    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-data\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.268379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.268222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-podinfo\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.268379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.268251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktx7p\" (UniqueName: \"kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-kube-api-access-ktx7p\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.268379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.268319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-envoy\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.268379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.268345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istiod-ca-cert\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.268521 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.268451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-socket\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.268521 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.268483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-certs\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.268586 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.268546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-token\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.268586 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.268567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-credential-socket\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.369443 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.369398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istiod-ca-cert\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.369925 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.369468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-socket\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.369925 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.369487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-certs\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.369925 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.369522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-token\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.369925 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.369543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-credential-socket\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.369925 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.369568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-data\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.369925 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.369614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-podinfo\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.369925 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.369638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktx7p\" (UniqueName: \"kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-kube-api-access-ktx7p\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.369925 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.369688    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-envoy\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.370404 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.369940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-data\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.370404 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.370025    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-credential-socket\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.370404 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.370093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-certs\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.370404 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.370224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istiod-ca-cert\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.370404 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.370281    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-socket\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.372265 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.372242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-envoy\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.372390 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.372371    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-podinfo\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.378267 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.378238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-token\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.378404 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.378364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktx7p\" (UniqueName: \"kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-kube-api-access-ktx7p\") pod \"e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") " pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.417501 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.417398    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:29.465742 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.465697    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:29.625039 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.625011    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"]
Jul 28 13:04:29.627537 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:04:29.627504    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c3dfe4_d7f2_4d2a_8bfc_273502fc11c4.slice/crio-bcc5d1410fcfe3e514394c971e17c940beb0bbbaa6b672849a10e6e6c153a1ce WatchSource:0}: Error finding container bcc5d1410fcfe3e514394c971e17c940beb0bbbaa6b672849a10e6e6c153a1ce: Status 404 returned error can't find the container with id bcc5d1410fcfe3e514394c971e17c940beb0bbbaa6b672849a10e6e6c153a1ce
Jul 28 13:04:29.630134 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.630103    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:04:29.630215 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.630171    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:04:29.630215 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:29.630200    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:04:30.096811 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:30.096776    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" event={"ID":"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4","Type":"ContainerStarted","Data":"3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a"}
Jul 28 13:04:30.097029 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:30.096830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" event={"ID":"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4","Type":"ContainerStarted","Data":"bcc5d1410fcfe3e514394c971e17c940beb0bbbaa6b672849a10e6e6c153a1ce"}
Jul 28 13:04:30.119596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:30.119537    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" podStartSLOduration=1.119517759 podStartE2EDuration="1.119517759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:04:30.117769827 +0000 UTC m=+2078.727635537" watchObservedRunningTime="2026-07-28 13:04:30.119517759 +0000 UTC m=+2078.729383529"
Jul 28 13:04:30.466884 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:30.466847    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:30.472296 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:30.472269    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:31.102322 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:31.102115    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:31.117428 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:31.117382    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:31.477699 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:31.477670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:31.575213 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:31.575177    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:31.695449 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:31.695404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:32.211725 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.211689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:32.327046 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.327015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:04:32.389175 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.389136    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"]
Jul 28 13:04:32.392917 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.392891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:04:32.395023 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.395001    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-bd87d0c9\""
Jul 28 13:04:32.395511 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.395494    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-bd87d0c9-dockercfg-s6cj5\""
Jul 28 13:04:32.405580 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.405550    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"]
Jul 28 13:04:32.477556 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.477461    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"]
Jul 28 13:04:32.481324 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.481300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:04:32.490154 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.490126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"]
Jul 28 13:04:32.500066 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.500031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxdwq\" (UniqueName: \"kubernetes.io/projected/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-kube-api-access-cxdwq\") pod \"payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd\" (UID: \"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:04:32.500261 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.500118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd\" (UID: \"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:04:32.601661 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.601614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-plugins-config-volume\") pod \"payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts\" (UID: \"1476a0a3-d058-40d0-9a98-d1dc2b6f0047\") " pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:04:32.601856 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.601675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd\" (UID: \"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:04:32.601856 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.601794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg28t\" (UniqueName: \"kubernetes.io/projected/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-kube-api-access-dg28t\") pod \"payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts\" (UID: \"1476a0a3-d058-40d0-9a98-d1dc2b6f0047\") " pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:04:32.601856 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.601842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxdwq\" (UniqueName: \"kubernetes.io/projected/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-kube-api-access-cxdwq\") pod \"payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd\" (UID: \"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:04:32.602380 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.602360    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd\" (UID: \"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:04:32.609766 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.609730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxdwq\" (UniqueName: \"kubernetes.io/projected/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-kube-api-access-cxdwq\") pod \"payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd\" (UID: \"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:04:32.702851 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.702810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg28t\" (UniqueName: \"kubernetes.io/projected/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-kube-api-access-dg28t\") pod \"payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts\" (UID: \"1476a0a3-d058-40d0-9a98-d1dc2b6f0047\") " pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:04:32.703113 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.702898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-plugins-config-volume\") pod \"payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts\" (UID: \"1476a0a3-d058-40d0-9a98-d1dc2b6f0047\") " pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:04:32.703632 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.703612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-plugins-config-volume\") pod \"payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts\" (UID: \"1476a0a3-d058-40d0-9a98-d1dc2b6f0047\") " pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:04:32.704617 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.704597    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:04:32.711025 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.710993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg28t\" (UniqueName: \"kubernetes.io/projected/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-kube-api-access-dg28t\") pod \"payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts\" (UID: \"1476a0a3-d058-40d0-9a98-d1dc2b6f0047\") " pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:04:32.795020 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.794967    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:04:32.864496 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:04:32.864455    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b6e2d9_57b3_4983_8438_bd58b7efa2a5.slice/crio-68c68202b9489be0fb2b8bbe80abb198f5c043dab7c94d73fcc24f975621af5c WatchSource:0}: Error finding container 68c68202b9489be0fb2b8bbe80abb198f5c043dab7c94d73fcc24f975621af5c: Status 404 returned error can't find the container with id 68c68202b9489be0fb2b8bbe80abb198f5c043dab7c94d73fcc24f975621af5c
Jul 28 13:04:32.864496 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.864458    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"]
Jul 28 13:04:32.959574 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:32.959545    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"]
Jul 28 13:04:32.961568 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:04:32.961541    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1476a0a3_d058_40d0_9a98_d1dc2b6f0047.slice/crio-9bbe739ce69f48f3897be60ec60426a5f315f86363b80b5b08e62f26b1f33994 WatchSource:0}: Error finding container 9bbe739ce69f48f3897be60ec60426a5f315f86363b80b5b08e62f26b1f33994: Status 404 returned error can't find the container with id 9bbe739ce69f48f3897be60ec60426a5f315f86363b80b5b08e62f26b1f33994
Jul 28 13:04:33.115515 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.115444    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts" event={"ID":"1476a0a3-d058-40d0-9a98-d1dc2b6f0047","Type":"ContainerStarted","Data":"83097a4c25923cd6c5c513cbd727678e998b13e093c569853609c040b8d1188d"}
Jul 28 13:04:33.115746 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.115525    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:04:33.115746 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.115552    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts" event={"ID":"1476a0a3-d058-40d0-9a98-d1dc2b6f0047","Type":"ContainerStarted","Data":"9bbe739ce69f48f3897be60ec60426a5f315f86363b80b5b08e62f26b1f33994"}
Jul 28 13:04:33.117370 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.117344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd" event={"ID":"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5","Type":"ContainerStarted","Data":"cba732906434e15cd7b669e339bf53ca289d7ac46fc3417bd0f8012044bcb7bc"}
Jul 28 13:04:33.117530 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.117391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd" event={"ID":"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5","Type":"ContainerStarted","Data":"68c68202b9489be0fb2b8bbe80abb198f5c043dab7c94d73fcc24f975621af5c"}
Jul 28 13:04:33.117530 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.117498    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:04:33.134423 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.134352    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts" podStartSLOduration=1.134335821 podStartE2EDuration="1.134335821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:04:33.132536297 +0000 UTC m=+2081.742402004" watchObservedRunningTime="2026-07-28 13:04:33.134335821 +0000 UTC m=+2081.744201528"
Jul 28 13:04:33.150595 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.150532    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd" podStartSLOduration=1.150514741 podStartE2EDuration="1.150514741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:04:33.148319582 +0000 UTC m=+2081.758185291" watchObservedRunningTime="2026-07-28 13:04:33.150514741 +0000 UTC m=+2081.760380448"
Jul 28 13:04:33.600413 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.600386    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:04:33.715639 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.715606    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-envoy\") pod \"522f2c58-680d-4670-9028-892a54bd2e25\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") "
Jul 28 13:04:33.715829 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.715675    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522f2c58-680d-4670-9028-892a54bd2e25-istiod-ca-cert\") pod \"522f2c58-680d-4670-9028-892a54bd2e25\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") "
Jul 28 13:04:33.715829 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.715711    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522f2c58-680d-4670-9028-892a54bd2e25-istio-podinfo\") pod \"522f2c58-680d-4670-9028-892a54bd2e25\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") "
Jul 28 13:04:33.715829 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.715733    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-istio-token\") pod \"522f2c58-680d-4670-9028-892a54bd2e25\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") "
Jul 28 13:04:33.715829 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.715763    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-credential-socket\") pod \"522f2c58-680d-4670-9028-892a54bd2e25\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") "
Jul 28 13:04:33.715829 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.715791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-socket\") pod \"522f2c58-680d-4670-9028-892a54bd2e25\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") "
Jul 28 13:04:33.715829 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.715812    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-certs\") pod \"522f2c58-680d-4670-9028-892a54bd2e25\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") "
Jul 28 13:04:33.716188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.715842    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82r8b\" (UniqueName: \"kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-kube-api-access-82r8b\") pod \"522f2c58-680d-4670-9028-892a54bd2e25\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") "
Jul 28 13:04:33.716188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.715908    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-data\") pod \"522f2c58-680d-4670-9028-892a54bd2e25\" (UID: \"522f2c58-680d-4670-9028-892a54bd2e25\") "
Jul 28 13:04:33.716188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.716146    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "522f2c58-680d-4670-9028-892a54bd2e25" (UID: "522f2c58-680d-4670-9028-892a54bd2e25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:04:33.716188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.716162    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "522f2c58-680d-4670-9028-892a54bd2e25" (UID: "522f2c58-680d-4670-9028-892a54bd2e25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:04:33.716188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.716179    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/522f2c58-680d-4670-9028-892a54bd2e25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "522f2c58-680d-4670-9028-892a54bd2e25" (UID: "522f2c58-680d-4670-9028-892a54bd2e25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:04:33.716437 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.716315    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "522f2c58-680d-4670-9028-892a54bd2e25" (UID: "522f2c58-680d-4670-9028-892a54bd2e25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:04:33.716437 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.716364    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522f2c58-680d-4670-9028-892a54bd2e25-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:33.716437 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.716384    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:33.716437 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.716398    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:33.717299 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.717267    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-data" (OuterVolumeSpecName: "istio-data") pod "522f2c58-680d-4670-9028-892a54bd2e25" (UID: "522f2c58-680d-4670-9028-892a54bd2e25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:04:33.718292 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.718267    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/522f2c58-680d-4670-9028-892a54bd2e25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "522f2c58-680d-4670-9028-892a54bd2e25" (UID: "522f2c58-680d-4670-9028-892a54bd2e25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:04:33.718438 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.718416    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "522f2c58-680d-4670-9028-892a54bd2e25" (UID: "522f2c58-680d-4670-9028-892a54bd2e25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:04:33.718502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.718489    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-kube-api-access-82r8b" (OuterVolumeSpecName: "kube-api-access-82r8b") pod "522f2c58-680d-4670-9028-892a54bd2e25" (UID: "522f2c58-680d-4670-9028-892a54bd2e25"). InnerVolumeSpecName "kube-api-access-82r8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:04:33.718543 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.718488    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-istio-token" (OuterVolumeSpecName: "istio-token") pod "522f2c58-680d-4670-9028-892a54bd2e25" (UID: "522f2c58-680d-4670-9028-892a54bd2e25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:04:33.817474 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.817438    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82r8b\" (UniqueName: \"kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-kube-api-access-82r8b\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:33.817474 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.817469    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:33.817474 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.817479    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:33.817474 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.817487    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522f2c58-680d-4670-9028-892a54bd2e25-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:33.817809 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.817495    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522f2c58-680d-4670-9028-892a54bd2e25-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:33.817809 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:33.817503    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f2c58-680d-4670-9028-892a54bd2e25-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:04:34.123943 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.123910    2565 generic.go:356] "Generic (PLEG): container finished" podID="522f2c58-680d-4670-9028-892a54bd2e25" containerID="19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad" exitCode=0
Jul 28 13:04:34.124152 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.123995    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"
Jul 28 13:04:34.124152 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.124014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" event={"ID":"522f2c58-680d-4670-9028-892a54bd2e25","Type":"ContainerDied","Data":"19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad"}
Jul 28 13:04:34.124152 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.124077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps" event={"ID":"522f2c58-680d-4670-9028-892a54bd2e25","Type":"ContainerDied","Data":"d19308cfda90939904aef836859e1db71b4f3da3d59a4abbecb4d43ef7848ca6"}
Jul 28 13:04:34.124152 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.124106    2565 scope.go:117] "RemoveContainer" containerID="19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad"
Jul 28 13:04:34.134153 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.134133    2565 scope.go:117] "RemoveContainer" containerID="534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a"
Jul 28 13:04:34.141434 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.141400    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"]
Jul 28 13:04:34.143950 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.143925    2565 scope.go:117] "RemoveContainer" containerID="19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad"
Jul 28 13:04:34.144341 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:04:34.144321    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad\": container with ID starting with 19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad not found: ID does not exist" containerID="19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad"
Jul 28 13:04:34.144393 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.144353    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad"} err="failed to get container status \"19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad\": rpc error: code = NotFound desc = could not find container \"19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad\": container with ID starting with 19b290fe805634304730450b5d72115c18625967b5aed0a787dcc34a2e1023ad not found: ID does not exist"
Jul 28 13:04:34.144393 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.144372    2565 scope.go:117] "RemoveContainer" containerID="534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a"
Jul 28 13:04:34.144629 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:04:34.144613    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a\": container with ID starting with 534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a not found: ID does not exist" containerID="534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a"
Jul 28 13:04:34.144686 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.144630    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a"} err="failed to get container status \"534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a\": rpc error: code = NotFound desc = could not find container \"534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a\": container with ID starting with 534e85357d0aeb3c99af062748d652209d74a69f0f35a82321c5e0055fc5b54a not found: ID does not exist"
Jul 28 13:04:34.148217 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:34.148186    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ce27c48c-openshift-default-b6f877878-zn4ps"]
Jul 28 13:04:35.900111 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:35.900075    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="522f2c58-680d-4670-9028-892a54bd2e25" path="/var/lib/kubelet/pods/522f2c58-680d-4670-9028-892a54bd2e25/volumes"
Jul 28 13:04:44.127074 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:44.127042    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:04:44.127543 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:44.127115    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:04:46.104011 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:46.103942    2565 patch_prober.go:28] interesting pod/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 28 13:04:46.104534 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:46.104043    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 28 13:04:46.193079 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:46.193045    2565 generic.go:356] "Generic (PLEG): container finished" podID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerID="3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a" exitCode=0
Jul 28 13:04:46.193283 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:46.193123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" event={"ID":"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4","Type":"ContainerDied","Data":"3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a"}
Jul 28 13:04:46.193652 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:46.193633    2565 scope.go:117] "RemoveContainer" containerID="3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a"
Jul 28 13:04:46.194795 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:46.194765    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:04:46.194907 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:46.194855    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:04:46.195014 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:46.194903    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:04:47.201215 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:47.201178    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" event={"ID":"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4","Type":"ContainerStarted","Data":"d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5"}
Jul 28 13:04:47.466448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:47.466345    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:47.466680 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:47.466653    2565 patch_prober.go:28] interesting pod/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 28 13:04:47.466745 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:47.466715    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 28 13:04:48.466542 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:48.466500    2565 patch_prober.go:28] interesting pod/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 28 13:04:48.467022 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:48.466561    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 28 13:04:49.467199 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:49.467160    2565 patch_prober.go:28] interesting pod/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 28 13:04:49.467621 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:49.467235    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 28 13:04:50.466359 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:50.466323    2565 patch_prober.go:28] interesting pod/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 28 13:04:50.466567 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:50.466399    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 28 13:04:51.467106 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:51.467070    2565 patch_prober.go:28] interesting pod/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 28 13:04:51.467523 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:51.467133    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 28 13:04:52.470926 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:52.470896    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:52.471441 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:52.471295    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:04:52.472285 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:04:52.472260    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:05:00.993025 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:00.992959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:01.092569 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:01.092533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:01.555997 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:01.555948    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:05:01.558543 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:01.558516    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:05:07.087720 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.087684    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"]
Jul 28 13:05:07.088198 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.087911    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts" podUID="1476a0a3-d058-40d0-9a98-d1dc2b6f0047" containerName="payload-processing" containerID="cri-o://83097a4c25923cd6c5c513cbd727678e998b13e093c569853609c040b8d1188d" gracePeriod=30
Jul 28 13:05:07.095049 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.095012    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"]
Jul 28 13:05:07.095379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.095322    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd" podUID="c5b6e2d9-57b3-4983-8438-bd58b7efa2a5" containerName="payload-pre-processing" containerID="cri-o://cba732906434e15cd7b669e339bf53ca289d7ac46fc3417bd0f8012044bcb7bc" gracePeriod=30
Jul 28 13:05:07.153825 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.153792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:07.254598 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.254560    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:07.304454 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.304420    2565 generic.go:356] "Generic (PLEG): container finished" podID="c5b6e2d9-57b3-4983-8438-bd58b7efa2a5" containerID="cba732906434e15cd7b669e339bf53ca289d7ac46fc3417bd0f8012044bcb7bc" exitCode=0
Jul 28 13:05:07.304693 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.304494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd" event={"ID":"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5","Type":"ContainerDied","Data":"cba732906434e15cd7b669e339bf53ca289d7ac46fc3417bd0f8012044bcb7bc"}
Jul 28 13:05:07.306380 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.306348    2565 generic.go:356] "Generic (PLEG): container finished" podID="1476a0a3-d058-40d0-9a98-d1dc2b6f0047" containerID="83097a4c25923cd6c5c513cbd727678e998b13e093c569853609c040b8d1188d" exitCode=0
Jul 28 13:05:07.306541 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.306430    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts" event={"ID":"1476a0a3-d058-40d0-9a98-d1dc2b6f0047","Type":"ContainerDied","Data":"83097a4c25923cd6c5c513cbd727678e998b13e093c569853609c040b8d1188d"}
Jul 28 13:05:07.354042 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.353954    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:05:07.391123 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.391095    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:05:07.449090 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.449055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dg28t\" (UniqueName: \"kubernetes.io/projected/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-kube-api-access-dg28t\") pod \"1476a0a3-d058-40d0-9a98-d1dc2b6f0047\" (UID: \"1476a0a3-d058-40d0-9a98-d1dc2b6f0047\") "
Jul 28 13:05:07.449284 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.449115    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-plugins-config-volume\") pod \"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5\" (UID: \"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5\") "
Jul 28 13:05:07.449284 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.449170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-plugins-config-volume\") pod \"1476a0a3-d058-40d0-9a98-d1dc2b6f0047\" (UID: \"1476a0a3-d058-40d0-9a98-d1dc2b6f0047\") "
Jul 28 13:05:07.449284 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.449231    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxdwq\" (UniqueName: \"kubernetes.io/projected/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-kube-api-access-cxdwq\") pod \"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5\" (UID: \"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5\") "
Jul 28 13:05:07.449519 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.449494    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c5b6e2d9-57b3-4983-8438-bd58b7efa2a5" (UID: "c5b6e2d9-57b3-4983-8438-bd58b7efa2a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:05:07.449594 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.449573    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1476a0a3-d058-40d0-9a98-d1dc2b6f0047" (UID: "1476a0a3-d058-40d0-9a98-d1dc2b6f0047"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:05:07.451440 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.451414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-kube-api-access-cxdwq" (OuterVolumeSpecName: "kube-api-access-cxdwq") pod "c5b6e2d9-57b3-4983-8438-bd58b7efa2a5" (UID: "c5b6e2d9-57b3-4983-8438-bd58b7efa2a5"). InnerVolumeSpecName "kube-api-access-cxdwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:05:07.451510 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.451471    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-kube-api-access-dg28t" (OuterVolumeSpecName: "kube-api-access-dg28t") pod "1476a0a3-d058-40d0-9a98-d1dc2b6f0047" (UID: "1476a0a3-d058-40d0-9a98-d1dc2b6f0047"). InnerVolumeSpecName "kube-api-access-dg28t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:05:07.550959 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.550913    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxdwq\" (UniqueName: \"kubernetes.io/projected/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-kube-api-access-cxdwq\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:07.550959 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.550951    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dg28t\" (UniqueName: \"kubernetes.io/projected/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-kube-api-access-dg28t\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:07.550959 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.550961    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:07.550959 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:07.550970    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1476a0a3-d058-40d0-9a98-d1dc2b6f0047-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:08.312453 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:08.312410    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"
Jul 28 13:05:08.312453 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:08.312423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd" event={"ID":"c5b6e2d9-57b3-4983-8438-bd58b7efa2a5","Type":"ContainerDied","Data":"68c68202b9489be0fb2b8bbe80abb198f5c043dab7c94d73fcc24f975621af5c"}
Jul 28 13:05:08.313049 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:08.312494    2565 scope.go:117] "RemoveContainer" containerID="cba732906434e15cd7b669e339bf53ca289d7ac46fc3417bd0f8012044bcb7bc"
Jul 28 13:05:08.313888 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:08.313863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts" event={"ID":"1476a0a3-d058-40d0-9a98-d1dc2b6f0047","Type":"ContainerDied","Data":"9bbe739ce69f48f3897be60ec60426a5f315f86363b80b5b08e62f26b1f33994"}
Jul 28 13:05:08.313951 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:08.313921    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"
Jul 28 13:05:08.321467 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:08.321444    2565 scope.go:117] "RemoveContainer" containerID="83097a4c25923cd6c5c513cbd727678e998b13e093c569853609c040b8d1188d"
Jul 28 13:05:08.339552 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:08.339518    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"]
Jul 28 13:05:08.349101 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:08.349066    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bd87d0c9-d94fdb9b-znhzd"]
Jul 28 13:05:08.359551 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:08.359518    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"]
Jul 28 13:05:08.362853 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:08.362819    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bd87d0c9-589b9f5766-qc9ts"]
Jul 28 13:05:09.900037 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:09.899999    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1476a0a3-d058-40d0-9a98-d1dc2b6f0047" path="/var/lib/kubelet/pods/1476a0a3-d058-40d0-9a98-d1dc2b6f0047/volumes"
Jul 28 13:05:09.900444 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:09.900374    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5b6e2d9-57b3-4983-8438-bd58b7efa2a5" path="/var/lib/kubelet/pods/c5b6e2d9-57b3-4983-8438-bd58b7efa2a5/volumes"
Jul 28 13:05:11.540312 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:11.540282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:11.690309 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:11.690214    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"]
Jul 28 13:05:11.690576 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:11.690545    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy" containerID="cri-o://d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5" gracePeriod=30
Jul 28 13:05:11.707209 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:11.707172    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:11.954089 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:11.954050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:12.478767 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:12.478735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:12.573123 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:12.573070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:12.673201 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:12.673163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:14.081106 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:14.081058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:16.152650 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:16.152614    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:16.939738 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:16.939708    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:05:17.040619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.040509    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktx7p\" (UniqueName: \"kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-kube-api-access-ktx7p\") pod \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") "
Jul 28 13:05:17.040619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.040565    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-data\") pod \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") "
Jul 28 13:05:17.040619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.040596    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-credential-socket\") pod \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") "
Jul 28 13:05:17.040915 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.040626    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-socket\") pod \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") "
Jul 28 13:05:17.040915 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.040678    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-token\") pod \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") "
Jul 28 13:05:17.040915 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.040714    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-certs\") pod \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") "
Jul 28 13:05:17.040915 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.040749    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-podinfo\") pod \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") "
Jul 28 13:05:17.041177 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.040925    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" (UID: "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:05:17.041177 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.040967    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" (UID: "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:05:17.041177 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.041016    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-envoy\") pod \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") "
Jul 28 13:05:17.041177 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.041047    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" (UID: "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:05:17.041177 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.041062    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istiod-ca-cert\") pod \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\" (UID: \"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4\") "
Jul 28 13:05:17.041457 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.041410    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:17.041457 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.041442    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:17.041457 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.041442    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" (UID: "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:05:17.041795 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.041458    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:17.042017 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.041970    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" (UID: "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:05:17.043392 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.043362    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" (UID: "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:05:17.043509 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.043383    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" (UID: "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:05:17.043624 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.043607    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-kube-api-access-ktx7p" (OuterVolumeSpecName: "kube-api-access-ktx7p") pod "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" (UID: "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4"). InnerVolumeSpecName "kube-api-access-ktx7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:05:17.043676 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.043640    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" (UID: "85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:05:17.142520 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.142481    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:17.142520 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.142513    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:17.142520 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.142522    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:17.142520 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.142533    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:17.142813 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.142541    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktx7p\" (UniqueName: \"kubernetes.io/projected/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-kube-api-access-ktx7p\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:17.142813 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.142550    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:05:17.364379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.364288    2565 generic.go:356] "Generic (PLEG): container finished" podID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerID="d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5" exitCode=0
Jul 28 13:05:17.364379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.364347    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"
Jul 28 13:05:17.364379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.364355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" event={"ID":"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4","Type":"ContainerDied","Data":"d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5"}
Jul 28 13:05:17.364915 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.364410    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx" event={"ID":"85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4","Type":"ContainerDied","Data":"bcc5d1410fcfe3e514394c971e17c940beb0bbbaa6b672849a10e6e6c153a1ce"}
Jul 28 13:05:17.364915 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.364441    2565 scope.go:117] "RemoveContainer" containerID="d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5"
Jul 28 13:05:17.375100 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.375079    2565 scope.go:117] "RemoveContainer" containerID="3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a"
Jul 28 13:05:17.385874 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.385835    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"]
Jul 28 13:05:17.386155 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.386080    2565 scope.go:117] "RemoveContainer" containerID="d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5"
Jul 28 13:05:17.386455 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:05:17.386436    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5\": container with ID starting with d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5 not found: ID does not exist" containerID="d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5"
Jul 28 13:05:17.386524 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.386464    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5"} err="failed to get container status \"d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5\": rpc error: code = NotFound desc = could not find container \"d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5\": container with ID starting with d24d18c73f7ad04c98e3bf967477a0f9d24eaed10bb9f90a22324b75919be6e5 not found: ID does not exist"
Jul 28 13:05:17.386524 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.386485    2565 scope.go:117] "RemoveContainer" containerID="3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a"
Jul 28 13:05:17.386752 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:05:17.386739    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a\": container with ID starting with 3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a not found: ID does not exist" containerID="3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a"
Jul 28 13:05:17.386806 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.386755    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a"} err="failed to get container status \"3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a\": rpc error: code = NotFound desc = could not find container \"3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a\": container with ID starting with 3499de4f9b30691e9f771966251dbb35687a829c3be2539cc0cdb1e34a84295a not found: ID does not exist"
Jul 28 13:05:17.395542 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.395506    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bd87d0c9-openshift-default-7bffccf6cb-drzqx"]
Jul 28 13:05:17.906664 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:17.906631    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" path="/var/lib/kubelet/pods/85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4/volumes"
Jul 28 13:05:20.412172 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:20.412137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:20.572847 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:20.572814    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:20.667878 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:20.667803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:20.767159 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:20.767121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:21.155220 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:21.155186    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:47.298629 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:47.298542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:53.808703 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:53.808663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:53.870726 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:53.870690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:54.514450 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:54.514414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:54.613493 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:05:54.613440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:09.956938 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:09.956906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:15.806562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:15.806527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:15.879324 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:15.879281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:15.976041 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:15.975992    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:16.073002 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:16.072873    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:26.570132 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:26.570046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:27.380147 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:27.380110    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:34.807099 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:34.807058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:34.914089 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:34.914042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:35.011898 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:35.011863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:35.108786 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:35.108702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:48.806782 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:48.806747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:50.247707 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:50.247671    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:50.932499 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:50.932459    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:57.139164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:57.139127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:57.237167 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:57.237130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:57.822128 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:06:57.822084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:03.742770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:03.742729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:03.811777 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:03.811742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:04.031585 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.031503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:04.308673 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.308583    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"]
Jul 28 13:07:04.309165 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309143    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b6e2d9-57b3-4983-8438-bd58b7efa2a5" containerName="payload-pre-processing"
Jul 28 13:07:04.309263 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309168    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b6e2d9-57b3-4983-8438-bd58b7efa2a5" containerName="payload-pre-processing"
Jul 28 13:07:04.309263 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309183    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy"
Jul 28 13:07:04.309263 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309192    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy"
Jul 28 13:07:04.309263 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309204    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1476a0a3-d058-40d0-9a98-d1dc2b6f0047" containerName="payload-processing"
Jul 28 13:07:04.309263 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309213    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1476a0a3-d058-40d0-9a98-d1dc2b6f0047" containerName="payload-processing"
Jul 28 13:07:04.309263 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309235    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy"
Jul 28 13:07:04.309263 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309243    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy"
Jul 28 13:07:04.309504 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309269    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy"
Jul 28 13:07:04.309504 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309278    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy"
Jul 28 13:07:04.309504 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309394    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy"
Jul 28 13:07:04.309504 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309406    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1476a0a3-d058-40d0-9a98-d1dc2b6f0047" containerName="payload-processing"
Jul 28 13:07:04.309504 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309421    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy"
Jul 28 13:07:04.309504 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309440    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5b6e2d9-57b3-4983-8438-bd58b7efa2a5" containerName="payload-pre-processing"
Jul 28 13:07:04.309504 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.309450    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy"
Jul 28 13:07:04.312856 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.312833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.316741 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.316720    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c499a1e4-openshift-default-dockercfg-j48zl\""
Jul 28 13:07:04.316878 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.316767    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 13:07:04.337189 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.337154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"]
Jul 28 13:07:04.346445 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.346400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:04.369274 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.369229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-data\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.369465 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.369291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-certs\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.369465 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.369328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3bf131-2044-44db-8435-b9da3830dab1-istiod-ca-cert\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.369465 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.369356    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-socket\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.369465 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.369405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffspw\" (UniqueName: \"kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-kube-api-access-ffspw\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.369465 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.369460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3bf131-2044-44db-8435-b9da3830dab1-istio-podinfo\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.369638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.369483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-envoy\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.369638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.369519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-istio-token\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.369638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.369567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-credential-socket\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471097 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-certs\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471097 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3bf131-2044-44db-8435-b9da3830dab1-istiod-ca-cert\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-socket\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffspw\" (UniqueName: \"kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-kube-api-access-ffspw\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3bf131-2044-44db-8435-b9da3830dab1-istio-podinfo\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-envoy\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-istio-token\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-credential-socket\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-data\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471689 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-socket\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.471880 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.471857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-certs\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.472210 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.472151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3bf131-2044-44db-8435-b9da3830dab1-istiod-ca-cert\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.472210 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.472165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-credential-socket\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.472210 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.472172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-data\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.473859 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.473835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-envoy\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.473957 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.473859    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3bf131-2044-44db-8435-b9da3830dab1-istio-podinfo\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.479767 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.479735    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-istio-token\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.479901 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.479829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffspw\" (UniqueName: \"kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-kube-api-access-ffspw\") pod \"e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") " pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.511817 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.511778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:04.625275 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.625181    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:04.777084 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.777058    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"]
Jul 28 13:07:04.779424 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:07:04.779394    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3bf131_2044_44db_8435_b9da3830dab1.slice/crio-1c00e6b8fde81654a1b3818426a3462b6e8a9b67e98d66462fa3ac89ee4879b8 WatchSource:0}: Error finding container 1c00e6b8fde81654a1b3818426a3462b6e8a9b67e98d66462fa3ac89ee4879b8: Status 404 returned error can't find the container with id 1c00e6b8fde81654a1b3818426a3462b6e8a9b67e98d66462fa3ac89ee4879b8
Jul 28 13:07:04.781827 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.781790    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:07:04.781914 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.781882    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:07:04.781954 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.781923    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:07:04.900649 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.900553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" event={"ID":"6c3bf131-2044-44db-8435-b9da3830dab1","Type":"ContainerStarted","Data":"8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2"}
Jul 28 13:07:04.900649 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.900619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" event={"ID":"6c3bf131-2044-44db-8435-b9da3830dab1","Type":"ContainerStarted","Data":"1c00e6b8fde81654a1b3818426a3462b6e8a9b67e98d66462fa3ac89ee4879b8"}
Jul 28 13:07:04.922971 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:04.922901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" podStartSLOduration=0.922877494 podStartE2EDuration="922.877494ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:07:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:07:04.920384352 +0000 UTC m=+2233.530250059" watchObservedRunningTime="2026-07-28 13:07:04.922877494 +0000 UTC m=+2233.532743202"
Jul 28 13:07:05.625716 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:05.625675    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:05.631136 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:05.631107    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:05.905843 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:05.905762    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:05.906686 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:05.906666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:07.224123 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.224088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:07.325448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.325395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:07.425953 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.425909    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:07.742052 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.742013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:07.887104 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.887067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:07.955864 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.955822    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"]
Jul 28 13:07:07.956222 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.956208    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy"
Jul 28 13:07:07.956290 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.956224    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85c3dfe4-d7f2-4d2a-8bfc-273502fc11c4" containerName="istio-proxy"
Jul 28 13:07:07.956326 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.956313    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="522f2c58-680d-4670-9028-892a54bd2e25" containerName="istio-proxy"
Jul 28 13:07:07.958798 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.958771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:07.959522 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.959495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:07.961584 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.961564    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c499a1e4\""
Jul 28 13:07:07.967713 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.967681    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"]
Jul 28 13:07:07.997268 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:07.997162    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"]
Jul 28 13:07:08.000649 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.000624    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:08.004936 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.004905    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c499a1e4-dockercfg-jcqm7\""
Jul 28 13:07:08.005105 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.005043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-857kj\" (UniqueName: \"kubernetes.io/projected/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-kube-api-access-857kj\") pod \"payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm\" (UID: \"da6b5843-b34c-4d6e-bd1e-3831d4f18f05\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:08.005264 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.005238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm\" (UID: \"da6b5843-b34c-4d6e-bd1e-3831d4f18f05\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:08.017234 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.017199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"]
Jul 28 13:07:08.106398 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.106360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm\" (UID: \"da6b5843-b34c-4d6e-bd1e-3831d4f18f05\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:08.106619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.106416    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjqq\" (UniqueName: \"kubernetes.io/projected/46baf529-d3a0-4c50-b134-9f0f79984680-kube-api-access-xfjqq\") pod \"payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch\" (UID: \"46baf529-d3a0-4c50-b134-9f0f79984680\") " pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:08.106619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.106461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-857kj\" (UniqueName: \"kubernetes.io/projected/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-kube-api-access-857kj\") pod \"payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm\" (UID: \"da6b5843-b34c-4d6e-bd1e-3831d4f18f05\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:08.106619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.106484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46baf529-d3a0-4c50-b134-9f0f79984680-plugins-config-volume\") pod \"payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch\" (UID: \"46baf529-d3a0-4c50-b134-9f0f79984680\") " pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:08.107101 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.107082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm\" (UID: \"da6b5843-b34c-4d6e-bd1e-3831d4f18f05\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:08.123155 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.123124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-857kj\" (UniqueName: \"kubernetes.io/projected/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-kube-api-access-857kj\") pod \"payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm\" (UID: \"da6b5843-b34c-4d6e-bd1e-3831d4f18f05\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:08.207779 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.207728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46baf529-d3a0-4c50-b134-9f0f79984680-plugins-config-volume\") pod \"payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch\" (UID: \"46baf529-d3a0-4c50-b134-9f0f79984680\") " pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:08.207972 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.207871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjqq\" (UniqueName: \"kubernetes.io/projected/46baf529-d3a0-4c50-b134-9f0f79984680-kube-api-access-xfjqq\") pod \"payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch\" (UID: \"46baf529-d3a0-4c50-b134-9f0f79984680\") " pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:08.208556 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.208535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46baf529-d3a0-4c50-b134-9f0f79984680-plugins-config-volume\") pod \"payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch\" (UID: \"46baf529-d3a0-4c50-b134-9f0f79984680\") " pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:08.224802 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.224771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjqq\" (UniqueName: \"kubernetes.io/projected/46baf529-d3a0-4c50-b134-9f0f79984680-kube-api-access-xfjqq\") pod \"payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch\" (UID: \"46baf529-d3a0-4c50-b134-9f0f79984680\") " pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:08.273226 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.273120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:08.311228 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.311189    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:08.438206 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.438175    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"]
Jul 28 13:07:08.440764 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:07:08.440723    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda6b5843_b34c_4d6e_bd1e_3831d4f18f05.slice/crio-725cc05dc13bab0e4a5642d845f873c48490a26ace62817b45d5b260a794f86e WatchSource:0}: Error finding container 725cc05dc13bab0e4a5642d845f873c48490a26ace62817b45d5b260a794f86e: Status 404 returned error can't find the container with id 725cc05dc13bab0e4a5642d845f873c48490a26ace62817b45d5b260a794f86e
Jul 28 13:07:08.473530 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.473498    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"]
Jul 28 13:07:08.481192 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:07:08.481161    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46baf529_d3a0_4c50_b134_9f0f79984680.slice/crio-dda35a9b8368d0eea9d0e2912aea703665c1b7c1823bd5e5cbf4706c00c5d09d WatchSource:0}: Error finding container dda35a9b8368d0eea9d0e2912aea703665c1b7c1823bd5e5cbf4706c00c5d09d: Status 404 returned error can't find the container with id dda35a9b8368d0eea9d0e2912aea703665c1b7c1823bd5e5cbf4706c00c5d09d
Jul 28 13:07:08.922727 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.922627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch" event={"ID":"46baf529-d3a0-4c50-b134-9f0f79984680","Type":"ContainerStarted","Data":"f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e"}
Jul 28 13:07:08.922727 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.922683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch" event={"ID":"46baf529-d3a0-4c50-b134-9f0f79984680","Type":"ContainerStarted","Data":"dda35a9b8368d0eea9d0e2912aea703665c1b7c1823bd5e5cbf4706c00c5d09d"}
Jul 28 13:07:08.922727 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.922717    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:08.924441 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.924406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm" event={"ID":"da6b5843-b34c-4d6e-bd1e-3831d4f18f05","Type":"ContainerStarted","Data":"e3a80e83714027e033b8727dc1fd0c22f9385565c16980a069a68550d24c3a2b"}
Jul 28 13:07:08.924583 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.924468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:08.924583 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.924494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm" event={"ID":"da6b5843-b34c-4d6e-bd1e-3831d4f18f05","Type":"ContainerStarted","Data":"725cc05dc13bab0e4a5642d845f873c48490a26ace62817b45d5b260a794f86e"}
Jul 28 13:07:08.939656 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.939606    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch" podStartSLOduration=1.93958629 podStartE2EDuration="1.93958629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:07:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:07:08.938261329 +0000 UTC m=+2237.548127036" watchObservedRunningTime="2026-07-28 13:07:08.93958629 +0000 UTC m=+2237.549451997"
Jul 28 13:07:08.955595 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:08.955538    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm" podStartSLOduration=1.95552287 podStartE2EDuration="1.95552287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:07:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:07:08.95397012 +0000 UTC m=+2237.563835847" watchObservedRunningTime="2026-07-28 13:07:08.95552287 +0000 UTC m=+2237.565388575"
Jul 28 13:07:11.705914 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:11.705857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:12.421382 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:12.421347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:12.511736 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:12.511698    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:12.856617 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:12.856570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:18.626873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:18.626830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:18.699706 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:18.699658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:19.931452 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:19.931404    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm" podUID="da6b5843-b34c-4d6e-bd1e-3831d4f18f05" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.51:9004: connect: connection refused"
Jul 28 13:07:19.932001 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:19.931963    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:20.907801 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:20.907689    2565 patch_prober.go:28] interesting pod/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 28 13:07:20.907801 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:20.907784    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 28 13:07:20.987162 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:20.987129    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c3bf131-2044-44db-8435-b9da3830dab1" containerID="8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2" exitCode=0
Jul 28 13:07:20.987576 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:20.987184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" event={"ID":"6c3bf131-2044-44db-8435-b9da3830dab1","Type":"ContainerDied","Data":"8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2"}
Jul 28 13:07:20.987621 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:20.987600    2565 scope.go:117] "RemoveContainer" containerID="8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2"
Jul 28 13:07:20.988722 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:20.988697    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:07:20.988779 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:20.988767    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:07:20.988816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:20.988796    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:07:22.004936 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:22.004874    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" event={"ID":"6c3bf131-2044-44db-8435-b9da3830dab1","Type":"ContainerStarted","Data":"400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c"}
Jul 28 13:07:22.625785 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:22.625744    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:22.626077 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:22.626055    2565 patch_prober.go:28] interesting pod/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 28 13:07:22.626138 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:22.626104    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 28 13:07:23.625738 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:23.625695    2565 patch_prober.go:28] interesting pod/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 28 13:07:23.626209 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:23.625776    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 28 13:07:24.625988 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:24.625948    2565 patch_prober.go:28] interesting pod/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 28 13:07:24.626435 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:24.626070    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 28 13:07:24.675155 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:24.675120    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:25.625659 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:25.625614    2565 patch_prober.go:28] interesting pod/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 28 13:07:25.625912 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:25.625674    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 28 13:07:26.630554 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:26.630520    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:26.630998 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:26.630818    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:26.631707 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:26.631689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:29.726070 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:29.726029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:29.751816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:29.751781    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"]
Jul 28 13:07:29.752115 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:29.752081    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch" podUID="46baf529-d3a0-4c50-b134-9f0f79984680" containerName="payload-processing" containerID="cri-o://f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e" gracePeriod=30
Jul 28 13:07:29.764264 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:29.764222    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"]
Jul 28 13:07:29.764517 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:29.764485    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm" podUID="da6b5843-b34c-4d6e-bd1e-3831d4f18f05" containerName="payload-pre-processing" containerID="cri-o://e3a80e83714027e033b8727dc1fd0c22f9385565c16980a069a68550d24c3a2b" gracePeriod=30
Jul 28 13:07:29.765383 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:29.765360    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:29.823673 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:29.823630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:29.923900 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:29.923857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:29.930191 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:29.930149    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch" podUID="46baf529-d3a0-4c50-b134-9f0f79984680" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.52:9004: connect: connection refused"
Jul 28 13:07:30.031996 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.031958    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:30.048640 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.048603    2565 generic.go:356] "Generic (PLEG): container finished" podID="da6b5843-b34c-4d6e-bd1e-3831d4f18f05" containerID="e3a80e83714027e033b8727dc1fd0c22f9385565c16980a069a68550d24c3a2b" exitCode=0
Jul 28 13:07:30.048873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.048849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm" event={"ID":"da6b5843-b34c-4d6e-bd1e-3831d4f18f05","Type":"ContainerDied","Data":"e3a80e83714027e033b8727dc1fd0c22f9385565c16980a069a68550d24c3a2b"}
Jul 28 13:07:30.050574 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.050472    2565 generic.go:356] "Generic (PLEG): container finished" podID="46baf529-d3a0-4c50-b134-9f0f79984680" containerID="f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e" exitCode=0
Jul 28 13:07:30.050574 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.050512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch" event={"ID":"46baf529-d3a0-4c50-b134-9f0f79984680","Type":"ContainerDied","Data":"f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e"}
Jul 28 13:07:30.050574 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.050543    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"
Jul 28 13:07:30.050574 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.050558    2565 scope.go:117] "RemoveContainer" containerID="f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e"
Jul 28 13:07:30.050886 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.050548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch" event={"ID":"46baf529-d3a0-4c50-b134-9f0f79984680","Type":"ContainerDied","Data":"dda35a9b8368d0eea9d0e2912aea703665c1b7c1823bd5e5cbf4706c00c5d09d"}
Jul 28 13:07:30.063665 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.063628    2565 scope.go:117] "RemoveContainer" containerID="f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e"
Jul 28 13:07:30.063910 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:07:30.063892    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e\": container with ID starting with f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e not found: ID does not exist" containerID="f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e"
Jul 28 13:07:30.063959 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.063919    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e"} err="failed to get container status \"f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e\": rpc error: code = NotFound desc = could not find container \"f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e\": container with ID starting with f6b320c8a9294c3148129583a2116d2f9f4f5347b3dea53f62bec45a0cbc942e not found: ID does not exist"
Jul 28 13:07:30.065474 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.065453    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:30.131971 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.131937    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfjqq\" (UniqueName: \"kubernetes.io/projected/46baf529-d3a0-4c50-b134-9f0f79984680-kube-api-access-xfjqq\") pod \"46baf529-d3a0-4c50-b134-9f0f79984680\" (UID: \"46baf529-d3a0-4c50-b134-9f0f79984680\") "
Jul 28 13:07:30.131971 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.132028    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46baf529-d3a0-4c50-b134-9f0f79984680-plugins-config-volume\") pod \"46baf529-d3a0-4c50-b134-9f0f79984680\" (UID: \"46baf529-d3a0-4c50-b134-9f0f79984680\") "
Jul 28 13:07:30.132403 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.132374    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46baf529-d3a0-4c50-b134-9f0f79984680-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "46baf529-d3a0-4c50-b134-9f0f79984680" (UID: "46baf529-d3a0-4c50-b134-9f0f79984680"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:07:30.134285 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.134257    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46baf529-d3a0-4c50-b134-9f0f79984680-kube-api-access-xfjqq" (OuterVolumeSpecName: "kube-api-access-xfjqq") pod "46baf529-d3a0-4c50-b134-9f0f79984680" (UID: "46baf529-d3a0-4c50-b134-9f0f79984680"). InnerVolumeSpecName "kube-api-access-xfjqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:07:30.233055 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.232966    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-plugins-config-volume\") pod \"da6b5843-b34c-4d6e-bd1e-3831d4f18f05\" (UID: \"da6b5843-b34c-4d6e-bd1e-3831d4f18f05\") "
Jul 28 13:07:30.233260 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.233120    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-857kj\" (UniqueName: \"kubernetes.io/projected/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-kube-api-access-857kj\") pod \"da6b5843-b34c-4d6e-bd1e-3831d4f18f05\" (UID: \"da6b5843-b34c-4d6e-bd1e-3831d4f18f05\") "
Jul 28 13:07:30.233358 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.233345    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfjqq\" (UniqueName: \"kubernetes.io/projected/46baf529-d3a0-4c50-b134-9f0f79984680-kube-api-access-xfjqq\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:30.233416 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.233363    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/46baf529-d3a0-4c50-b134-9f0f79984680-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:30.233416 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.233337    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da6b5843-b34c-4d6e-bd1e-3831d4f18f05" (UID: "da6b5843-b34c-4d6e-bd1e-3831d4f18f05"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:07:30.235433 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.235409    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-kube-api-access-857kj" (OuterVolumeSpecName: "kube-api-access-857kj") pod "da6b5843-b34c-4d6e-bd1e-3831d4f18f05" (UID: "da6b5843-b34c-4d6e-bd1e-3831d4f18f05"). InnerVolumeSpecName "kube-api-access-857kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:07:30.334580 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.334478    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:30.334580 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.334514    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-857kj\" (UniqueName: \"kubernetes.io/projected/da6b5843-b34c-4d6e-bd1e-3831d4f18f05-kube-api-access-857kj\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:30.372181 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.372146    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"]
Jul 28 13:07:30.374531 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:30.374503    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c499a1e4-d8468fccd-xjxch"]
Jul 28 13:07:31.058429 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:31.058334    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"
Jul 28 13:07:31.058429 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:31.058334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm" event={"ID":"da6b5843-b34c-4d6e-bd1e-3831d4f18f05","Type":"ContainerDied","Data":"725cc05dc13bab0e4a5642d845f873c48490a26ace62817b45d5b260a794f86e"}
Jul 28 13:07:31.059035 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:31.058464    2565 scope.go:117] "RemoveContainer" containerID="e3a80e83714027e033b8727dc1fd0c22f9385565c16980a069a68550d24c3a2b"
Jul 28 13:07:31.080694 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:31.080660    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"]
Jul 28 13:07:31.085283 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:31.085251    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c499a1e4-58c568db76-csvbm"]
Jul 28 13:07:31.901611 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:31.901572    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46baf529-d3a0-4c50-b134-9f0f79984680" path="/var/lib/kubelet/pods/46baf529-d3a0-4c50-b134-9f0f79984680/volumes"
Jul 28 13:07:31.901953 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:31.901939    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da6b5843-b34c-4d6e-bd1e-3831d4f18f05" path="/var/lib/kubelet/pods/da6b5843-b34c-4d6e-bd1e-3831d4f18f05/volumes"
Jul 28 13:07:34.173202 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:34.173162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:34.595218 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:34.595179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:40.223888 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:40.223851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:40.287482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:40.287448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:40.519651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:40.519551    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"]
Jul 28 13:07:40.519812 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:40.519764    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy" containerID="cri-o://400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c" gracePeriod=30
Jul 28 13:07:40.541777 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:40.541743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:40.774664 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:40.774567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:40.923029 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:40.922996    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:41.020818 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:41.020790    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:41.184521 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:41.184434    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:41.633072 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:41.633025    2565 patch_prober.go:28] interesting pod/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 13:07:41.633517 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:41.633110    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 13:07:45.779363 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.779288    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:45.885184 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885143    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-envoy\") pod \"6c3bf131-2044-44db-8435-b9da3830dab1\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") "
Jul 28 13:07:45.885184 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885192    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-istio-token\") pod \"6c3bf131-2044-44db-8435-b9da3830dab1\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") "
Jul 28 13:07:45.885442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885211    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-credential-socket\") pod \"6c3bf131-2044-44db-8435-b9da3830dab1\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") "
Jul 28 13:07:45.885442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885248    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-certs\") pod \"6c3bf131-2044-44db-8435-b9da3830dab1\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") "
Jul 28 13:07:45.885442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-socket\") pod \"6c3bf131-2044-44db-8435-b9da3830dab1\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") "
Jul 28 13:07:45.885442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885307    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3bf131-2044-44db-8435-b9da3830dab1-istio-podinfo\") pod \"6c3bf131-2044-44db-8435-b9da3830dab1\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") "
Jul 28 13:07:45.885442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885353    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-data\") pod \"6c3bf131-2044-44db-8435-b9da3830dab1\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") "
Jul 28 13:07:45.885731 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3bf131-2044-44db-8435-b9da3830dab1-istiod-ca-cert\") pod \"6c3bf131-2044-44db-8435-b9da3830dab1\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") "
Jul 28 13:07:45.885731 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885484    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffspw\" (UniqueName: \"kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-kube-api-access-ffspw\") pod \"6c3bf131-2044-44db-8435-b9da3830dab1\" (UID: \"6c3bf131-2044-44db-8435-b9da3830dab1\") "
Jul 28 13:07:45.885731 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885602    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c3bf131-2044-44db-8435-b9da3830dab1" (UID: "6c3bf131-2044-44db-8435-b9da3830dab1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:07:45.885731 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885654    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c3bf131-2044-44db-8435-b9da3830dab1" (UID: "6c3bf131-2044-44db-8435-b9da3830dab1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:07:45.885731 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885670    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c3bf131-2044-44db-8435-b9da3830dab1" (UID: "6c3bf131-2044-44db-8435-b9da3830dab1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:07:45.886000 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885843    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:45.886000 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885863    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:45.886000 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.885877    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:45.886193 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.886170    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3bf131-2044-44db-8435-b9da3830dab1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c3bf131-2044-44db-8435-b9da3830dab1" (UID: "6c3bf131-2044-44db-8435-b9da3830dab1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:07:45.886583 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.886555    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c3bf131-2044-44db-8435-b9da3830dab1" (UID: "6c3bf131-2044-44db-8435-b9da3830dab1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:07:45.887651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.887628    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c3bf131-2044-44db-8435-b9da3830dab1" (UID: "6c3bf131-2044-44db-8435-b9da3830dab1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:07:45.887885 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.887855    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-kube-api-access-ffspw" (OuterVolumeSpecName: "kube-api-access-ffspw") pod "6c3bf131-2044-44db-8435-b9da3830dab1" (UID: "6c3bf131-2044-44db-8435-b9da3830dab1"). InnerVolumeSpecName "kube-api-access-ffspw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:07:45.888103 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.888080    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c3bf131-2044-44db-8435-b9da3830dab1" (UID: "6c3bf131-2044-44db-8435-b9da3830dab1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:07:45.888187 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.888109    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c3bf131-2044-44db-8435-b9da3830dab1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c3bf131-2044-44db-8435-b9da3830dab1" (UID: "6c3bf131-2044-44db-8435-b9da3830dab1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:07:45.986394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.986352    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3bf131-2044-44db-8435-b9da3830dab1-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:45.986394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.986386    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffspw\" (UniqueName: \"kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-kube-api-access-ffspw\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:45.986394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.986398    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:45.986394 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.986409    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3bf131-2044-44db-8435-b9da3830dab1-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:45.986693 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.986419    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3bf131-2044-44db-8435-b9da3830dab1-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:45.986693 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:45.986430    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3bf131-2044-44db-8435-b9da3830dab1-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:07:46.137725 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.137622    2565 generic.go:356] "Generic (PLEG): container finished" podID="6c3bf131-2044-44db-8435-b9da3830dab1" containerID="400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c" exitCode=0
Jul 28 13:07:46.137725 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.137672    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"
Jul 28 13:07:46.137725 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.137695    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" event={"ID":"6c3bf131-2044-44db-8435-b9da3830dab1","Type":"ContainerDied","Data":"400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c"}
Jul 28 13:07:46.138013 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.137751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz" event={"ID":"6c3bf131-2044-44db-8435-b9da3830dab1","Type":"ContainerDied","Data":"1c00e6b8fde81654a1b3818426a3462b6e8a9b67e98d66462fa3ac89ee4879b8"}
Jul 28 13:07:46.138013 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.137774    2565 scope.go:117] "RemoveContainer" containerID="400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c"
Jul 28 13:07:46.147183 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.147165    2565 scope.go:117] "RemoveContainer" containerID="8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2"
Jul 28 13:07:46.154426 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.154395    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"]
Jul 28 13:07:46.157140 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.157115    2565 scope.go:117] "RemoveContainer" containerID="400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c"
Jul 28 13:07:46.157520 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:07:46.157486    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c\": container with ID starting with 400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c not found: ID does not exist" containerID="400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c"
Jul 28 13:07:46.157621 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.157529    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c"} err="failed to get container status \"400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c\": rpc error: code = NotFound desc = could not find container \"400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c\": container with ID starting with 400dc4c760904171f68dc73410233640bcc60a5269629387f6bab460e9971b4c not found: ID does not exist"
Jul 28 13:07:46.157621 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.157549    2565 scope.go:117] "RemoveContainer" containerID="8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2"
Jul 28 13:07:46.157872 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:07:46.157851    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2\": container with ID starting with 8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2 not found: ID does not exist" containerID="8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2"
Jul 28 13:07:46.157957 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.157877    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2"} err="failed to get container status \"8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2\": rpc error: code = NotFound desc = could not find container \"8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2\": container with ID starting with 8ede4330965e027969e84a7da20a7495372b80a992532de9d078ff3c809d59d2 not found: ID does not exist"
Jul 28 13:07:46.158684 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:46.158660    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c499a1e4-openshift-default-599c69c75b-tnjhz"]
Jul 28 13:07:47.039817 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:47.039779    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:47.140666 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:47.140630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:47.297420 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:47.297326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:47.387266 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:47.387231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:47.487222 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:47.487189    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:47.899728 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:47.899693    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" path="/var/lib/kubelet/pods/6c3bf131-2044-44db-8435-b9da3830dab1/volumes"
Jul 28 13:07:53.372770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:53.372735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:53.473627 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:07:53.473587    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:00.526051 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.526016    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:00.900301 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900195    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"]
Jul 28 13:08:00.900721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900706    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy"
Jul 28 13:08:00.900770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900725    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy"
Jul 28 13:08:00.900770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900738    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da6b5843-b34c-4d6e-bd1e-3831d4f18f05" containerName="payload-pre-processing"
Jul 28 13:08:00.900770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900749    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da6b5843-b34c-4d6e-bd1e-3831d4f18f05" containerName="payload-pre-processing"
Jul 28 13:08:00.900770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900759    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46baf529-d3a0-4c50-b134-9f0f79984680" containerName="payload-processing"
Jul 28 13:08:00.900770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900767    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="46baf529-d3a0-4c50-b134-9f0f79984680" containerName="payload-processing"
Jul 28 13:08:00.900938 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900778    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy"
Jul 28 13:08:00.900938 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900786    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy"
Jul 28 13:08:00.900938 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900880    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy"
Jul 28 13:08:00.900938 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900892    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="46baf529-d3a0-4c50-b134-9f0f79984680" containerName="payload-processing"
Jul 28 13:08:00.900938 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900903    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c3bf131-2044-44db-8435-b9da3830dab1" containerName="istio-proxy"
Jul 28 13:08:00.900938 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.900913    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da6b5843-b34c-4d6e-bd1e-3831d4f18f05" containerName="payload-pre-processing"
Jul 28 13:08:00.904177 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.904155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:00.906728 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.906704    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0e7d2b19-openshift-default-dockercfg-phql9\""
Jul 28 13:08:00.906863 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.906764    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 13:08:00.917169 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.917138    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"]
Jul 28 13:08:00.929522 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:00.929485    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:01.028286 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.028235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jjrj\" (UniqueName: \"kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-kube-api-access-7jjrj\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.028286 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.028288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-envoy\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.028562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.028345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-credential-socket\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.028562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.028383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-certs\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.028562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.028418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-data\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.028562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.028433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-istio-token\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.028562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.028484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e73eb3b8-4880-4528-9956-c388dcab7471-istiod-ca-cert\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.028562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.028501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e73eb3b8-4880-4528-9956-c388dcab7471-istio-podinfo\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.028562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.028550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-socket\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129211 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-envoy\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129211 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-credential-socket\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129230    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-certs\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-data\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129275    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-istio-token\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e73eb3b8-4880-4528-9956-c388dcab7471-istiod-ca-cert\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e73eb3b8-4880-4528-9956-c388dcab7471-istio-podinfo\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-socket\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jjrj\" (UniqueName: \"kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-kube-api-access-7jjrj\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129765 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-credential-socket\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129876 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-socket\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.129964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.129938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-data\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.130048 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.130027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-certs\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.130144 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.130128    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e73eb3b8-4880-4528-9956-c388dcab7471-istiod-ca-cert\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.131815 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.131793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-envoy\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.132045 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.132027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e73eb3b8-4880-4528-9956-c388dcab7471-istio-podinfo\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.138816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.138789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-istio-token\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.139945 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.139864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jjrj\" (UniqueName: \"kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-kube-api-access-7jjrj\") pod \"e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") " pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.140468 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.140443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:01.214822 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.214790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:01.363162 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.363135    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"]
Jul 28 13:08:01.365618 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:08:01.365585    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode73eb3b8_4880_4528_9956_c388dcab7471.slice/crio-423793303e28cc86909b8972d651a6f4dc788b33043f497304ebbac45d4608e9 WatchSource:0}: Error finding container 423793303e28cc86909b8972d651a6f4dc788b33043f497304ebbac45d4608e9: Status 404 returned error can't find the container with id 423793303e28cc86909b8972d651a6f4dc788b33043f497304ebbac45d4608e9
Jul 28 13:08:01.368155 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.368117    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:08:01.368244 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.368205    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:08:01.368284 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:01.368245    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:08:02.222654 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:02.222617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" event={"ID":"e73eb3b8-4880-4528-9956-c388dcab7471","Type":"ContainerStarted","Data":"ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57"}
Jul 28 13:08:02.223077 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:02.222677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" event={"ID":"e73eb3b8-4880-4528-9956-c388dcab7471","Type":"ContainerStarted","Data":"423793303e28cc86909b8972d651a6f4dc788b33043f497304ebbac45d4608e9"}
Jul 28 13:08:02.242875 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:02.242818    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" podStartSLOduration=2.242800777 podStartE2EDuration="2.242800777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:08:02.240855331 +0000 UTC m=+2290.850721039" watchObservedRunningTime="2026-07-28 13:08:02.242800777 +0000 UTC m=+2290.852666485"
Jul 28 13:08:03.215165 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:03.215127    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:03.220635 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:03.220602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:03.228750 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:03.228718    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:03.229625 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:03.229603    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:04.309444 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:04.309403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:04.410515 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:04.410484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:04.583764 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:04.583682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:04.809084 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:04.809052    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:05.088410 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.088362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:05.182580 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.182544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:05.194505 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.194465    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"]
Jul 28 13:08:05.198069 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.198038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:05.206158 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.206127    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0e7d2b19-dockercfg-lhhjx\""
Jul 28 13:08:05.206158 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.206150    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0e7d2b19\""
Jul 28 13:08:05.209893 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.209865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"]
Jul 28 13:08:05.237130 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.237102    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"]
Jul 28 13:08:05.240653 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.240633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:05.249767 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.249740    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"]
Jul 28 13:08:05.269309 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.269276    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m4ft\" (UniqueName: \"kubernetes.io/projected/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-kube-api-access-4m4ft\") pod \"payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx\" (UID: \"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:05.269504 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.269392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx\" (UID: \"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:05.370126 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.370021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx\" (UID: \"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:05.370610 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.370159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m4ft\" (UniqueName: \"kubernetes.io/projected/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-kube-api-access-4m4ft\") pod \"payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx\" (UID: \"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:05.370610 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.370198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25e1d40d-857e-458e-a58a-14ae419bcfba-plugins-config-volume\") pod \"payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd\" (UID: \"25e1d40d-857e-458e-a58a-14ae419bcfba\") " pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:05.370610 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.370359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcv4c\" (UniqueName: \"kubernetes.io/projected/25e1d40d-857e-458e-a58a-14ae419bcfba-kube-api-access-tcv4c\") pod \"payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd\" (UID: \"25e1d40d-857e-458e-a58a-14ae419bcfba\") " pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:05.370905 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.370881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx\" (UID: \"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:05.378907 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.378884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m4ft\" (UniqueName: \"kubernetes.io/projected/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-kube-api-access-4m4ft\") pod \"payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx\" (UID: \"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:05.471325 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.471283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25e1d40d-857e-458e-a58a-14ae419bcfba-plugins-config-volume\") pod \"payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd\" (UID: \"25e1d40d-857e-458e-a58a-14ae419bcfba\") " pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:05.471520 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.471335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcv4c\" (UniqueName: \"kubernetes.io/projected/25e1d40d-857e-458e-a58a-14ae419bcfba-kube-api-access-tcv4c\") pod \"payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd\" (UID: \"25e1d40d-857e-458e-a58a-14ae419bcfba\") " pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:05.472050 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.472031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25e1d40d-857e-458e-a58a-14ae419bcfba-plugins-config-volume\") pod \"payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd\" (UID: \"25e1d40d-857e-458e-a58a-14ae419bcfba\") " pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:05.479532 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.479504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcv4c\" (UniqueName: \"kubernetes.io/projected/25e1d40d-857e-458e-a58a-14ae419bcfba-kube-api-access-tcv4c\") pod \"payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd\" (UID: \"25e1d40d-857e-458e-a58a-14ae419bcfba\") " pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:05.516628 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.516596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:05.551890 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.551855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:05.681177 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.680963    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"]
Jul 28 13:08:05.685013 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:08:05.684958    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc739ef05_0fff_41c2_9ab6_9ec0a0b950fe.slice/crio-624ba500b0cbf25bd320dbb7798d3447ec7204426f287859a3bfd93fbadab3b3 WatchSource:0}: Error finding container 624ba500b0cbf25bd320dbb7798d3447ec7204426f287859a3bfd93fbadab3b3: Status 404 returned error can't find the container with id 624ba500b0cbf25bd320dbb7798d3447ec7204426f287859a3bfd93fbadab3b3
Jul 28 13:08:05.716784 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:05.716751    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"]
Jul 28 13:08:05.721217 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:08:05.721189    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e1d40d_857e_458e_a58a_14ae419bcfba.slice/crio-d10b234493c21778d6d3c6cd69b673389f74c8ec582fc4c992ae98229ce3b5ed WatchSource:0}: Error finding container d10b234493c21778d6d3c6cd69b673389f74c8ec582fc4c992ae98229ce3b5ed: Status 404 returned error can't find the container with id d10b234493c21778d6d3c6cd69b673389f74c8ec582fc4c992ae98229ce3b5ed
Jul 28 13:08:06.245102 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:06.245067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd" event={"ID":"25e1d40d-857e-458e-a58a-14ae419bcfba","Type":"ContainerStarted","Data":"b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484"}
Jul 28 13:08:06.245278 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:06.245119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd" event={"ID":"25e1d40d-857e-458e-a58a-14ae419bcfba","Type":"ContainerStarted","Data":"d10b234493c21778d6d3c6cd69b673389f74c8ec582fc4c992ae98229ce3b5ed"}
Jul 28 13:08:06.245278 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:06.245173    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:06.246741 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:06.246712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx" event={"ID":"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe","Type":"ContainerStarted","Data":"368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69"}
Jul 28 13:08:06.246884 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:06.246762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx" event={"ID":"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe","Type":"ContainerStarted","Data":"624ba500b0cbf25bd320dbb7798d3447ec7204426f287859a3bfd93fbadab3b3"}
Jul 28 13:08:06.246884 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:06.246795    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:06.264151 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:06.264088    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd" podStartSLOduration=1.264069206 podStartE2EDuration="1.264069206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:08:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:08:06.261906278 +0000 UTC m=+2294.871771984" watchObservedRunningTime="2026-07-28 13:08:06.264069206 +0000 UTC m=+2294.873934914"
Jul 28 13:08:06.281168 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:06.281115    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx" podStartSLOduration=1.281098315 podStartE2EDuration="1.281098315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:08:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:08:06.28031036 +0000 UTC m=+2294.890176070" watchObservedRunningTime="2026-07-28 13:08:06.281098315 +0000 UTC m=+2294.890964056"
Jul 28 13:08:08.746953 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:08.746918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:16.431370 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.431330    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"]
Jul 28 13:08:16.436502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.436478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.439808 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.439778    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0e7d2b19\"/\"kube-root-ca.crt\""
Jul 28 13:08:16.439964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.439809    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0e7d2b19\"/\"openshift-service-ca.crt\""
Jul 28 13:08:16.440441 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.440420    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0e7d2b19\"/\"default-dockercfg-tf8sz\""
Jul 28 13:08:16.440506 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.440422    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0e7d2b19\"/\"e2e-lifecycle-model-0e7d2b19-kserve-self-signed-certs\""
Jul 28 13:08:16.446070 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.446005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"]
Jul 28 13:08:16.455408 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.455369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:16.480283 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.480250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-dshm\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.480484 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.480292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-home\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.480484 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.480318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-model-cache\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.480484 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.480375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-tmp-dir\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.480484 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.480435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bce9a038-c9c3-4178-ae31-4d11e89ed429-tls-certs\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.480667 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.480545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtjd4\" (UniqueName: \"kubernetes.io/projected/bce9a038-c9c3-4178-ae31-4d11e89ed429-kube-api-access-gtjd4\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.581843 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.581806    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtjd4\" (UniqueName: \"kubernetes.io/projected/bce9a038-c9c3-4178-ae31-4d11e89ed429-kube-api-access-gtjd4\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.582071 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.581865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-dshm\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.582071 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.581892    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-home\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.582071 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.581920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-model-cache\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.582071 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.581950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-tmp-dir\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.582332 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.582262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bce9a038-c9c3-4178-ae31-4d11e89ed429-tls-certs\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.582684 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.582659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-tmp-dir\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.582926 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.582890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-home\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.583054 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.583027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-model-cache\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.585623 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.585597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-dshm\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.587005 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.585804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bce9a038-c9c3-4178-ae31-4d11e89ed429-tls-certs\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.594567 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.594538    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtjd4\" (UniqueName: \"kubernetes.io/projected/bce9a038-c9c3-4178-ae31-4d11e89ed429-kube-api-access-gtjd4\") pod \"e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") " pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.750416 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.750378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:16.918723 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:16.918692    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"]
Jul 28 13:08:16.921268 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:08:16.921227    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbce9a038_c9c3_4178_ae31_4d11e89ed429.slice/crio-fbf05a3c9501139f3db582bdc24fed0c0d49252c32832ed218e2c2357da587ad WatchSource:0}: Error finding container fbf05a3c9501139f3db582bdc24fed0c0d49252c32832ed218e2c2357da587ad: Status 404 returned error can't find the container with id fbf05a3c9501139f3db582bdc24fed0c0d49252c32832ed218e2c2357da587ad
Jul 28 13:08:17.254120 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:17.254088    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:17.254322 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:17.254172    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:17.311031 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:17.310958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk" event={"ID":"bce9a038-c9c3-4178-ae31-4d11e89ed429","Type":"ContainerStarted","Data":"2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca"}
Jul 28 13:08:17.311213 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:17.311046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk" event={"ID":"bce9a038-c9c3-4178-ae31-4d11e89ed429","Type":"ContainerStarted","Data":"fbf05a3c9501139f3db582bdc24fed0c0d49252c32832ed218e2c2357da587ad"}
Jul 28 13:08:17.328470 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:17.328405    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk" podStartSLOduration=1.328382639 podStartE2EDuration="1.328382639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:08:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:08:17.328167686 +0000 UTC m=+2305.938033395" watchObservedRunningTime="2026-07-28 13:08:17.328382639 +0000 UTC m=+2305.938248348"
Jul 28 13:08:18.716639 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:18.716413    2565 patch_prober.go:28] interesting pod/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:33162->10.132.0.53:15021: read: connection reset by peer" start-of-body=
Jul 28 13:08:18.716639 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:18.716488    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": read tcp 10.132.0.2:33162->10.132.0.53:15021: read: connection reset by peer"
Jul 28 13:08:19.324562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:19.324528    2565 generic.go:356] "Generic (PLEG): container finished" podID="e73eb3b8-4880-4528-9956-c388dcab7471" containerID="ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57" exitCode=0
Jul 28 13:08:19.324769 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:19.324607    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" event={"ID":"e73eb3b8-4880-4528-9956-c388dcab7471","Type":"ContainerDied","Data":"ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57"}
Jul 28 13:08:19.325063 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:19.325048    2565 scope.go:117] "RemoveContainer" containerID="ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57"
Jul 28 13:08:19.326168 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:19.326140    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:08:19.326254 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:19.326226    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:08:19.326291 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:19.326263    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:08:20.332323 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:20.332284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" event={"ID":"e73eb3b8-4880-4528-9956-c388dcab7471","Type":"ContainerStarted","Data":"13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836"}
Jul 28 13:08:21.215950 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:21.215905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:21.216269 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:21.216245    2565 patch_prober.go:28] interesting pod/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 28 13:08:21.216339 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:21.216299    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 28 13:08:22.215872 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:22.215829    2565 patch_prober.go:28] interesting pod/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 28 13:08:22.216340 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:22.215897    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 28 13:08:23.215409 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:23.215369    2565 patch_prober.go:28] interesting pod/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 28 13:08:23.215610 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:23.215428    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 28 13:08:24.215766 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:24.215724    2565 patch_prober.go:28] interesting pod/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 28 13:08:24.216255 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:24.215786    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 28 13:08:25.219681 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:25.219643    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:25.220107 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:25.220020    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:25.220832 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:25.220812    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:08:26.751504 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:26.751467    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:26.751927 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:26.751524    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:26.764715 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:26.764684    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:27.381762 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:27.381734    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:08:52.083005 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:52.082906    2565 scope.go:117] "RemoveContainer" containerID="496dcc2bd1a83b985456d045b220ac37b998885131d1873760358c4d22eab99f"
Jul 28 13:08:53.992756 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:53.992718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:54.026591 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.026555    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"]
Jul 28 13:08:54.027265 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.027229    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd" podUID="25e1d40d-857e-458e-a58a-14ae419bcfba" containerName="payload-processing" containerID="cri-o://b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484" gracePeriod=30
Jul 28 13:08:54.039113 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.039079    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"]
Jul 28 13:08:54.040891 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.040847    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx" podUID="c739ef05-0fff-41c2-9ab6-9ec0a0b950fe" containerName="payload-pre-processing" containerID="cri-o://368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69" gracePeriod=30
Jul 28 13:08:54.140523 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.140469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:54.212619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.212586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:54.304540 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.304510    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:54.332638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.332611    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:54.463946 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.463904    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25e1d40d-857e-458e-a58a-14ae419bcfba-plugins-config-volume\") pod \"25e1d40d-857e-458e-a58a-14ae419bcfba\" (UID: \"25e1d40d-857e-458e-a58a-14ae419bcfba\") "
Jul 28 13:08:54.464161 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.464026    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m4ft\" (UniqueName: \"kubernetes.io/projected/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-kube-api-access-4m4ft\") pod \"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe\" (UID: \"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe\") "
Jul 28 13:08:54.464161 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.464049    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcv4c\" (UniqueName: \"kubernetes.io/projected/25e1d40d-857e-458e-a58a-14ae419bcfba-kube-api-access-tcv4c\") pod \"25e1d40d-857e-458e-a58a-14ae419bcfba\" (UID: \"25e1d40d-857e-458e-a58a-14ae419bcfba\") "
Jul 28 13:08:54.464161 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.464078    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-plugins-config-volume\") pod \"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe\" (UID: \"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe\") "
Jul 28 13:08:54.464531 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.464507    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25e1d40d-857e-458e-a58a-14ae419bcfba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "25e1d40d-857e-458e-a58a-14ae419bcfba" (UID: "25e1d40d-857e-458e-a58a-14ae419bcfba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:08:54.464531 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.464517    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c739ef05-0fff-41c2-9ab6-9ec0a0b950fe" (UID: "c739ef05-0fff-41c2-9ab6-9ec0a0b950fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:08:54.466436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.466410    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25e1d40d-857e-458e-a58a-14ae419bcfba-kube-api-access-tcv4c" (OuterVolumeSpecName: "kube-api-access-tcv4c") pod "25e1d40d-857e-458e-a58a-14ae419bcfba" (UID: "25e1d40d-857e-458e-a58a-14ae419bcfba"). InnerVolumeSpecName "kube-api-access-tcv4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:08:54.466560 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.466538    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-kube-api-access-4m4ft" (OuterVolumeSpecName: "kube-api-access-4m4ft") pod "c739ef05-0fff-41c2-9ab6-9ec0a0b950fe" (UID: "c739ef05-0fff-41c2-9ab6-9ec0a0b950fe"). InnerVolumeSpecName "kube-api-access-4m4ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:08:54.507770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.507670    2565 generic.go:356] "Generic (PLEG): container finished" podID="25e1d40d-857e-458e-a58a-14ae419bcfba" containerID="b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484" exitCode=0
Jul 28 13:08:54.507770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.507728    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"
Jul 28 13:08:54.507770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.507756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd" event={"ID":"25e1d40d-857e-458e-a58a-14ae419bcfba","Type":"ContainerDied","Data":"b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484"}
Jul 28 13:08:54.508161 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.507816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd" event={"ID":"25e1d40d-857e-458e-a58a-14ae419bcfba","Type":"ContainerDied","Data":"d10b234493c21778d6d3c6cd69b673389f74c8ec582fc4c992ae98229ce3b5ed"}
Jul 28 13:08:54.508161 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.507843    2565 scope.go:117] "RemoveContainer" containerID="b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484"
Jul 28 13:08:54.509160 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.509132    2565 generic.go:356] "Generic (PLEG): container finished" podID="c739ef05-0fff-41c2-9ab6-9ec0a0b950fe" containerID="368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69" exitCode=0
Jul 28 13:08:54.509275 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.509167    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"
Jul 28 13:08:54.509275 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.509192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx" event={"ID":"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe","Type":"ContainerDied","Data":"368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69"}
Jul 28 13:08:54.509435 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.509355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx" event={"ID":"c739ef05-0fff-41c2-9ab6-9ec0a0b950fe","Type":"ContainerDied","Data":"624ba500b0cbf25bd320dbb7798d3447ec7204426f287859a3bfd93fbadab3b3"}
Jul 28 13:08:54.517773 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.517729    2565 scope.go:117] "RemoveContainer" containerID="b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484"
Jul 28 13:08:54.518263 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:08:54.518242    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484\": container with ID starting with b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484 not found: ID does not exist" containerID="b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484"
Jul 28 13:08:54.518357 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.518272    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484"} err="failed to get container status \"b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484\": rpc error: code = NotFound desc = could not find container \"b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484\": container with ID starting with b29e3a6ea7abd2b078a3e37a315b596ee2b5dd8d512d69782c16a80e021e7484 not found: ID does not exist"
Jul 28 13:08:54.518357 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.518295    2565 scope.go:117] "RemoveContainer" containerID="368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69"
Jul 28 13:08:54.527345 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.527323    2565 scope.go:117] "RemoveContainer" containerID="368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69"
Jul 28 13:08:54.527723 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:08:54.527703    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69\": container with ID starting with 368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69 not found: ID does not exist" containerID="368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69"
Jul 28 13:08:54.527780 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.527732    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69"} err="failed to get container status \"368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69\": rpc error: code = NotFound desc = could not find container \"368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69\": container with ID starting with 368a7a0a0473cb99f993963f9d7a9c8989e059ddb58222b2632a1c2ad8a82c69 not found: ID does not exist"
Jul 28 13:08:54.532553 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.532521    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"]
Jul 28 13:08:54.536848 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.536813    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0e7d2b19-8f8767c4-pzmwd"]
Jul 28 13:08:54.549499 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.549467    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"]
Jul 28 13:08:54.553328 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.553292    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0e7d2b19-75d657bb76-lb8rx"]
Jul 28 13:08:54.565596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.565555    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/25e1d40d-857e-458e-a58a-14ae419bcfba-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:08:54.565596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.565591    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m4ft\" (UniqueName: \"kubernetes.io/projected/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-kube-api-access-4m4ft\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:08:54.565789 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.565606    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcv4c\" (UniqueName: \"kubernetes.io/projected/25e1d40d-857e-458e-a58a-14ae419bcfba-kube-api-access-tcv4c\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:08:54.565789 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:54.565620    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:08:55.901092 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:55.901049    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25e1d40d-857e-458e-a58a-14ae419bcfba" path="/var/lib/kubelet/pods/25e1d40d-857e-458e-a58a-14ae419bcfba/volumes"
Jul 28 13:08:55.901627 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:55.901599    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c739ef05-0fff-41c2-9ab6-9ec0a0b950fe" path="/var/lib/kubelet/pods/c739ef05-0fff-41c2-9ab6-9ec0a0b950fe/volumes"
Jul 28 13:08:58.551267 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:08:58.551234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:01.986076 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:01.986042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:03.426235 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:03.426200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:06.967005 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:06.966948    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"]
Jul 28 13:09:07.062867 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:07.062832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:21.987504 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:21.987451    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk" podUID="bce9a038-c9c3-4178-ae31-4d11e89ed429" containerName="main" containerID="cri-o://2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca" gracePeriod=45
Jul 28 13:09:22.252610 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.252528    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:09:22.339737 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.339691    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bce9a038-c9c3-4178-ae31-4d11e89ed429-tls-certs\") pod \"bce9a038-c9c3-4178-ae31-4d11e89ed429\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") "
Jul 28 13:09:22.339737 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.339740    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-home\") pod \"bce9a038-c9c3-4178-ae31-4d11e89ed429\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") "
Jul 28 13:09:22.340022 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.339786    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-tmp-dir\") pod \"bce9a038-c9c3-4178-ae31-4d11e89ed429\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") "
Jul 28 13:09:22.340022 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.339889    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-dshm\") pod \"bce9a038-c9c3-4178-ae31-4d11e89ed429\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") "
Jul 28 13:09:22.340022 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.339932    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-model-cache\") pod \"bce9a038-c9c3-4178-ae31-4d11e89ed429\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") "
Jul 28 13:09:22.340022 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.339998    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtjd4\" (UniqueName: \"kubernetes.io/projected/bce9a038-c9c3-4178-ae31-4d11e89ed429-kube-api-access-gtjd4\") pod \"bce9a038-c9c3-4178-ae31-4d11e89ed429\" (UID: \"bce9a038-c9c3-4178-ae31-4d11e89ed429\") "
Jul 28 13:09:22.340242 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.340015    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-home" (OuterVolumeSpecName: "home") pod "bce9a038-c9c3-4178-ae31-4d11e89ed429" (UID: "bce9a038-c9c3-4178-ae31-4d11e89ed429"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:09:22.340242 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.340100    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bce9a038-c9c3-4178-ae31-4d11e89ed429" (UID: "bce9a038-c9c3-4178-ae31-4d11e89ed429"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:09:22.340242 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.340187    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-model-cache" (OuterVolumeSpecName: "model-cache") pod "bce9a038-c9c3-4178-ae31-4d11e89ed429" (UID: "bce9a038-c9c3-4178-ae31-4d11e89ed429"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:09:22.340406 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.340363    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-model-cache\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:22.340406 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.340385    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-home\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:22.340406 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.340399    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-tmp-dir\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:22.342316 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.342285    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bce9a038-c9c3-4178-ae31-4d11e89ed429-kube-api-access-gtjd4" (OuterVolumeSpecName: "kube-api-access-gtjd4") pod "bce9a038-c9c3-4178-ae31-4d11e89ed429" (UID: "bce9a038-c9c3-4178-ae31-4d11e89ed429"). InnerVolumeSpecName "kube-api-access-gtjd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:09:22.342471 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.342328    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bce9a038-c9c3-4178-ae31-4d11e89ed429-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bce9a038-c9c3-4178-ae31-4d11e89ed429" (UID: "bce9a038-c9c3-4178-ae31-4d11e89ed429"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:09:22.342547 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.342476    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-dshm" (OuterVolumeSpecName: "dshm") pod "bce9a038-c9c3-4178-ae31-4d11e89ed429" (UID: "bce9a038-c9c3-4178-ae31-4d11e89ed429"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:09:22.440914 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.440883    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bce9a038-c9c3-4178-ae31-4d11e89ed429-dshm\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:22.440914 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.440911    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtjd4\" (UniqueName: \"kubernetes.io/projected/bce9a038-c9c3-4178-ae31-4d11e89ed429-kube-api-access-gtjd4\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:22.441193 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.440927    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bce9a038-c9c3-4178-ae31-4d11e89ed429-tls-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:22.650579 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.650476    2565 generic.go:356] "Generic (PLEG): container finished" podID="bce9a038-c9c3-4178-ae31-4d11e89ed429" containerID="2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca" exitCode=0
Jul 28 13:09:22.650579 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.650525    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"
Jul 28 13:09:22.650579 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.650558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk" event={"ID":"bce9a038-c9c3-4178-ae31-4d11e89ed429","Type":"ContainerDied","Data":"2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca"}
Jul 28 13:09:22.650844 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.650601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk" event={"ID":"bce9a038-c9c3-4178-ae31-4d11e89ed429","Type":"ContainerDied","Data":"fbf05a3c9501139f3db582bdc24fed0c0d49252c32832ed218e2c2357da587ad"}
Jul 28 13:09:22.650844 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.650619    2565 scope.go:117] "RemoveContainer" containerID="2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca"
Jul 28 13:09:22.660674 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.660649    2565 scope.go:117] "RemoveContainer" containerID="2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca"
Jul 28 13:09:22.661017 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:09:22.660968    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca\": container with ID starting with 2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca not found: ID does not exist" containerID="2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca"
Jul 28 13:09:22.661101 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.661019    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca"} err="failed to get container status \"2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca\": rpc error: code = NotFound desc = could not find container \"2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca\": container with ID starting with 2f9e3edd81f8e99c813e3e47415b3a201f455826832b369c0fff788694156eca not found: ID does not exist"
Jul 28 13:09:22.671578 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.671547    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"]
Jul 28 13:09:22.675223 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:22.675182    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0e7d2b19/e2e-lifecycle-model-0e7d2b19-kserve-79d8cd9bc5-vngmk"]
Jul 28 13:09:23.899784 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:23.899745    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bce9a038-c9c3-4178-ae31-4d11e89ed429" path="/var/lib/kubelet/pods/bce9a038-c9c3-4178-ae31-4d11e89ed429/volumes"
Jul 28 13:09:43.109115 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:43.109080    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:44.434749 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:44.434717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:45.444070 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:45.444036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:50.219895 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:50.219859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:50.304857 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:50.304808    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:50.509388 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:50.509296    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"]
Jul 28 13:09:50.526679 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:50.526633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:50.769089 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:50.768967    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:50.800363 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:50.800314    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy" containerID="cri-o://13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836" gracePeriod=30
Jul 28 13:09:51.885596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:51.885562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:51.982947 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:51.982914    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:52.083974 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:52.083940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:52.874957 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:52.874919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:52.974536 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:52.974498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:53.076140 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:53.076105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:54.507607 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:54.507564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:09:55.223219 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:55.223155    2565 patch_prober.go:28] interesting pod/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 13:09:55.223479 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:55.223260    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 13:09:56.071342 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.071270    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:09:56.160830 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.160783    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jjrj\" (UniqueName: \"kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-kube-api-access-7jjrj\") pod \"e73eb3b8-4880-4528-9956-c388dcab7471\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") "
Jul 28 13:09:56.161033 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.160839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-certs\") pod \"e73eb3b8-4880-4528-9956-c388dcab7471\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") "
Jul 28 13:09:56.161033 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.160881    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e73eb3b8-4880-4528-9956-c388dcab7471-istiod-ca-cert\") pod \"e73eb3b8-4880-4528-9956-c388dcab7471\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") "
Jul 28 13:09:56.161033 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.160973    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e73eb3b8-4880-4528-9956-c388dcab7471-istio-podinfo\") pod \"e73eb3b8-4880-4528-9956-c388dcab7471\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") "
Jul 28 13:09:56.161176 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161088    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-envoy\") pod \"e73eb3b8-4880-4528-9956-c388dcab7471\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") "
Jul 28 13:09:56.161176 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161129    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-data\") pod \"e73eb3b8-4880-4528-9956-c388dcab7471\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") "
Jul 28 13:09:56.161176 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-istio-token\") pod \"e73eb3b8-4880-4528-9956-c388dcab7471\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") "
Jul 28 13:09:56.161328 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161196    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-socket\") pod \"e73eb3b8-4880-4528-9956-c388dcab7471\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") "
Jul 28 13:09:56.161328 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161204    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e73eb3b8-4880-4528-9956-c388dcab7471" (UID: "e73eb3b8-4880-4528-9956-c388dcab7471"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:09:56.161328 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161234    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-credential-socket\") pod \"e73eb3b8-4880-4528-9956-c388dcab7471\" (UID: \"e73eb3b8-4880-4528-9956-c388dcab7471\") "
Jul 28 13:09:56.161505 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161361    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e73eb3b8-4880-4528-9956-c388dcab7471-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e73eb3b8-4880-4528-9956-c388dcab7471" (UID: "e73eb3b8-4880-4528-9956-c388dcab7471"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:09:56.161505 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161492    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e73eb3b8-4880-4528-9956-c388dcab7471" (UID: "e73eb3b8-4880-4528-9956-c388dcab7471"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:09:56.161741 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161716    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:56.161843 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161740    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:56.161843 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161754    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e73eb3b8-4880-4528-9956-c388dcab7471-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:56.161843 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.161722    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e73eb3b8-4880-4528-9956-c388dcab7471" (UID: "e73eb3b8-4880-4528-9956-c388dcab7471"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:09:56.162542 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.162510    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-data" (OuterVolumeSpecName: "istio-data") pod "e73eb3b8-4880-4528-9956-c388dcab7471" (UID: "e73eb3b8-4880-4528-9956-c388dcab7471"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:09:56.163395 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.163372    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e73eb3b8-4880-4528-9956-c388dcab7471" (UID: "e73eb3b8-4880-4528-9956-c388dcab7471"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:09:56.163527 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.163448    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-kube-api-access-7jjrj" (OuterVolumeSpecName: "kube-api-access-7jjrj") pod "e73eb3b8-4880-4528-9956-c388dcab7471" (UID: "e73eb3b8-4880-4528-9956-c388dcab7471"). InnerVolumeSpecName "kube-api-access-7jjrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:09:56.163527 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.163509    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e73eb3b8-4880-4528-9956-c388dcab7471-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e73eb3b8-4880-4528-9956-c388dcab7471" (UID: "e73eb3b8-4880-4528-9956-c388dcab7471"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:09:56.164042 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.164018    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-istio-token" (OuterVolumeSpecName: "istio-token") pod "e73eb3b8-4880-4528-9956-c388dcab7471" (UID: "e73eb3b8-4880-4528-9956-c388dcab7471"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:09:56.262728 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.262688    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e73eb3b8-4880-4528-9956-c388dcab7471-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:56.262728 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.262719    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:56.262728 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.262729    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:56.262728 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.262738    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:56.263054 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.262746    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e73eb3b8-4880-4528-9956-c388dcab7471-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:56.263054 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.262757    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jjrj\" (UniqueName: \"kubernetes.io/projected/e73eb3b8-4880-4528-9956-c388dcab7471-kube-api-access-7jjrj\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:09:56.832580 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.832546    2565 generic.go:356] "Generic (PLEG): container finished" podID="e73eb3b8-4880-4528-9956-c388dcab7471" containerID="13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836" exitCode=0
Jul 28 13:09:56.832758 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.832594    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"
Jul 28 13:09:56.832758 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.832634    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" event={"ID":"e73eb3b8-4880-4528-9956-c388dcab7471","Type":"ContainerDied","Data":"13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836"}
Jul 28 13:09:56.832758 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.832688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp" event={"ID":"e73eb3b8-4880-4528-9956-c388dcab7471","Type":"ContainerDied","Data":"423793303e28cc86909b8972d651a6f4dc788b33043f497304ebbac45d4608e9"}
Jul 28 13:09:56.832758 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.832709    2565 scope.go:117] "RemoveContainer" containerID="13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836"
Jul 28 13:09:56.843037 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.843007    2565 scope.go:117] "RemoveContainer" containerID="ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57"
Jul 28 13:09:56.852184 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.852164    2565 scope.go:117] "RemoveContainer" containerID="13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836"
Jul 28 13:09:56.852483 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:09:56.852463    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836\": container with ID starting with 13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836 not found: ID does not exist" containerID="13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836"
Jul 28 13:09:56.852577 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.852491    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836"} err="failed to get container status \"13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836\": rpc error: code = NotFound desc = could not find container \"13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836\": container with ID starting with 13107553c9bdc2333cf1272cd46347e372510539614bb8f949a80f48cadcd836 not found: ID does not exist"
Jul 28 13:09:56.852577 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.852511    2565 scope.go:117] "RemoveContainer" containerID="ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57"
Jul 28 13:09:56.852840 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:09:56.852820    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57\": container with ID starting with ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57 not found: ID does not exist" containerID="ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57"
Jul 28 13:09:56.852920 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.852847    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57"} err="failed to get container status \"ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57\": rpc error: code = NotFound desc = could not find container \"ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57\": container with ID starting with ceb10f03f55601ef953c15402440ec6e04c57a765cb16bb464afa27b93ff7d57 not found: ID does not exist"
Jul 28 13:09:56.854125 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.854103    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"]
Jul 28 13:09:56.859040 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:56.859013    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0e7d2b19-openshift-default-66bc574c48-ltktp"]
Jul 28 13:09:57.900069 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:09:57.900034    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" path="/var/lib/kubelet/pods/e73eb3b8-4880-4528-9956-c388dcab7471/volumes"
Jul 28 13:10:00.274159 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:00.274127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:00.343410 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:00.343379    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:00.958612 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:00.958572    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:01.591256 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:01.591224    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:10:01.593522 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:01.593497    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:10:06.830350 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:06.830304    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:06.941280 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:06.941224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:07.036368 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:07.036333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:17.599720 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:17.599685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:17.987779 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:17.987748    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:38.963620 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:38.963583    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:45.362401 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:45.362358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:45.464360 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:45.464325    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:45.740820 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:45.740785    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:46.029479 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029389    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"]
Jul 28 13:10:46.029781 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029768    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy"
Jul 28 13:10:46.029823 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029783    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy"
Jul 28 13:10:46.029823 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029802    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25e1d40d-857e-458e-a58a-14ae419bcfba" containerName="payload-processing"
Jul 28 13:10:46.029823 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029808    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="25e1d40d-857e-458e-a58a-14ae419bcfba" containerName="payload-processing"
Jul 28 13:10:46.029823 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029819    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bce9a038-c9c3-4178-ae31-4d11e89ed429" containerName="main"
Jul 28 13:10:46.029949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029825    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bce9a038-c9c3-4178-ae31-4d11e89ed429" containerName="main"
Jul 28 13:10:46.029949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029838    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c739ef05-0fff-41c2-9ab6-9ec0a0b950fe" containerName="payload-pre-processing"
Jul 28 13:10:46.029949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029846    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c739ef05-0fff-41c2-9ab6-9ec0a0b950fe" containerName="payload-pre-processing"
Jul 28 13:10:46.029949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029896    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="25e1d40d-857e-458e-a58a-14ae419bcfba" containerName="payload-processing"
Jul 28 13:10:46.029949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029904    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bce9a038-c9c3-4178-ae31-4d11e89ed429" containerName="main"
Jul 28 13:10:46.029949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029915    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy"
Jul 28 13:10:46.029949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029925    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c739ef05-0fff-41c2-9ab6-9ec0a0b950fe" containerName="payload-pre-processing"
Jul 28 13:10:46.029949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.029930    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy"
Jul 28 13:10:46.033358 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.033332    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.035565 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.035541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c260d4-openshift-default-dockercfg-9tzl9\""
Jul 28 13:10:46.035894 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.035541    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 13:10:46.046739 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.046696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"]
Jul 28 13:10:46.058998 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.058948    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:46.122233 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.122192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-socket\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.122233 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.122237    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-podinfo\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.122502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.122258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-certs\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.122502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.122284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istiod-ca-cert\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.122502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.122369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-credential-socket\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.122502 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.122413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6kln\" (UniqueName: \"kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-kube-api-access-w6kln\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.122676 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.122528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-data\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.122676 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.122563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-envoy\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.122676 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.122589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-token\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.223894 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.223856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-data\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.223894 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.223898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-envoy\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.223920    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-token\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.223951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-socket\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.224028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-podinfo\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.224048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-certs\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.224070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istiod-ca-cert\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.224103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-credential-socket\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.224131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6kln\" (UniqueName: \"kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-kube-api-access-w6kln\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224534 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.224373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-data\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224534 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.224425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-socket\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224609 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.224542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-certs\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224609 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.224562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-credential-socket\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.224827 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.224808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istiod-ca-cert\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.226434 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.226415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-envoy\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.226903 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.226888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-podinfo\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.232378 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.232339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-token\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.232500 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.232418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6kln\" (UniqueName: \"kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-kube-api-access-w6kln\") pod \"e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") " pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.256225 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.256190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:46.345803 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.345709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:46.497494 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.497464    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"]
Jul 28 13:10:46.501650 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:10:46.501617    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb884e2cf_85ef_4bcb_bcbb_13a24df0d9cf.slice/crio-c885629035eab474861be67862857156295b53c6dc59d1d5ba33368a8e3d5e90 WatchSource:0}: Error finding container c885629035eab474861be67862857156295b53c6dc59d1d5ba33368a8e3d5e90: Status 404 returned error can't find the container with id c885629035eab474861be67862857156295b53c6dc59d1d5ba33368a8e3d5e90
Jul 28 13:10:46.504044 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.504014    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:10:46.504154 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.504080    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:10:46.504154 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:46.504110    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:10:47.077865 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:47.077829    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" event={"ID":"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf","Type":"ContainerStarted","Data":"6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952"}
Jul 28 13:10:47.077865 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:47.077878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" event={"ID":"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf","Type":"ContainerStarted","Data":"c885629035eab474861be67862857156295b53c6dc59d1d5ba33368a8e3d5e90"}
Jul 28 13:10:47.101326 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:47.101258    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" podStartSLOduration=1.101235522 podStartE2EDuration="1.101235522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:10:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:10:47.100771764 +0000 UTC m=+2455.710637515" watchObservedRunningTime="2026-07-28 13:10:47.101235522 +0000 UTC m=+2455.711101229"
Jul 28 13:10:47.346802 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:47.346703    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:47.352134 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:47.352103    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:48.082602 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:48.082563    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:48.083729 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:48.083710    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:10:49.068400 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.068367    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:49.153650 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.153616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:49.229664 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.229625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:49.332382 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.332300    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:49.737967 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.737930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:49.835867 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.835825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:49.842123 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.842088    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"]
Jul 28 13:10:49.842537 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.842518    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy"
Jul 28 13:10:49.842626 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.842539    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e73eb3b8-4880-4528-9956-c388dcab7471" containerName="istio-proxy"
Jul 28 13:10:49.845890 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.845866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:10:49.847932 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.847912    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c260d4\""
Jul 28 13:10:49.848089 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.848024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c260d4-dockercfg-85shd\""
Jul 28 13:10:49.858310 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.858258    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"]
Jul 28 13:10:49.877350 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.877310    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"]
Jul 28 13:10:49.880849 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.880830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:10:49.891334 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.891307    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"]
Jul 28 13:10:49.961448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.961412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99\" (UID: \"ebfcdf26-6108-44b3-a5a6-5438bd00cf71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:10:49.961647 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.961471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpgqr\" (UniqueName: \"kubernetes.io/projected/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-kube-api-access-bpgqr\") pod \"payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99\" (UID: \"ebfcdf26-6108-44b3-a5a6-5438bd00cf71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:10:49.961647 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.961560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15267f03-d6cc-4de3-96b4-d6353699d3fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4\" (UID: \"15267f03-d6cc-4de3-96b4-d6353699d3fe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:10:49.961647 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:49.961605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqbz9\" (UniqueName: \"kubernetes.io/projected/15267f03-d6cc-4de3-96b4-d6353699d3fe-kube-api-access-jqbz9\") pod \"payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4\" (UID: \"15267f03-d6cc-4de3-96b4-d6353699d3fe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:10:50.063167 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.063072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99\" (UID: \"ebfcdf26-6108-44b3-a5a6-5438bd00cf71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:10:50.063167 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.063132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpgqr\" (UniqueName: \"kubernetes.io/projected/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-kube-api-access-bpgqr\") pod \"payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99\" (UID: \"ebfcdf26-6108-44b3-a5a6-5438bd00cf71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:10:50.063167 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.063168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15267f03-d6cc-4de3-96b4-d6353699d3fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4\" (UID: \"15267f03-d6cc-4de3-96b4-d6353699d3fe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:10:50.063401 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.063188    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqbz9\" (UniqueName: \"kubernetes.io/projected/15267f03-d6cc-4de3-96b4-d6353699d3fe-kube-api-access-jqbz9\") pod \"payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4\" (UID: \"15267f03-d6cc-4de3-96b4-d6353699d3fe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:10:50.063851 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.063830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99\" (UID: \"ebfcdf26-6108-44b3-a5a6-5438bd00cf71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:10:50.063934 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.063913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15267f03-d6cc-4de3-96b4-d6353699d3fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4\" (UID: \"15267f03-d6cc-4de3-96b4-d6353699d3fe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:10:50.071509 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.071470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqbz9\" (UniqueName: \"kubernetes.io/projected/15267f03-d6cc-4de3-96b4-d6353699d3fe-kube-api-access-jqbz9\") pod \"payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4\" (UID: \"15267f03-d6cc-4de3-96b4-d6353699d3fe\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:10:50.071658 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.071470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpgqr\" (UniqueName: \"kubernetes.io/projected/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-kube-api-access-bpgqr\") pod \"payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99\" (UID: \"ebfcdf26-6108-44b3-a5a6-5438bd00cf71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:10:50.158146 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.158108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:10:50.191871 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.191836    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:10:50.319883 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.319844    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"]
Jul 28 13:10:50.321889 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:10:50.321853    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15267f03_d6cc_4de3_96b4_d6353699d3fe.slice/crio-6e386999b34a45874fc9cc012bc2d63483827fc1d430420d55c2f7cf555191b1 WatchSource:0}: Error finding container 6e386999b34a45874fc9cc012bc2d63483827fc1d430420d55c2f7cf555191b1: Status 404 returned error can't find the container with id 6e386999b34a45874fc9cc012bc2d63483827fc1d430420d55c2f7cf555191b1
Jul 28 13:10:50.351865 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:50.351830    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"]
Jul 28 13:10:50.357122 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:10:50.357093    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebfcdf26_6108_44b3_a5a6_5438bd00cf71.slice/crio-faf58ed8875476fac26feef623a0fcbeb6e7c708f58f7b81a6381becdfff01f7 WatchSource:0}: Error finding container faf58ed8875476fac26feef623a0fcbeb6e7c708f58f7b81a6381becdfff01f7: Status 404 returned error can't find the container with id faf58ed8875476fac26feef623a0fcbeb6e7c708f58f7b81a6381becdfff01f7
Jul 28 13:10:51.099056 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:51.099013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99" event={"ID":"ebfcdf26-6108-44b3-a5a6-5438bd00cf71","Type":"ContainerStarted","Data":"697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8"}
Jul 28 13:10:51.099293 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:51.099081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99" event={"ID":"ebfcdf26-6108-44b3-a5a6-5438bd00cf71","Type":"ContainerStarted","Data":"faf58ed8875476fac26feef623a0fcbeb6e7c708f58f7b81a6381becdfff01f7"}
Jul 28 13:10:51.099293 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:51.099133    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:10:51.100668 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:51.100641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4" event={"ID":"15267f03-d6cc-4de3-96b4-d6353699d3fe","Type":"ContainerStarted","Data":"e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738"}
Jul 28 13:10:51.100777 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:51.100691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4" event={"ID":"15267f03-d6cc-4de3-96b4-d6353699d3fe","Type":"ContainerStarted","Data":"6e386999b34a45874fc9cc012bc2d63483827fc1d430420d55c2f7cf555191b1"}
Jul 28 13:10:51.100777 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:51.100738    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:10:51.116757 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:51.116702    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99" podStartSLOduration=2.116686562 podStartE2EDuration="2.116686562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:10:51.114587681 +0000 UTC m=+2459.724453401" watchObservedRunningTime="2026-07-28 13:10:51.116686562 +0000 UTC m=+2459.726552297"
Jul 28 13:10:51.130133 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:51.130074    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4" podStartSLOduration=2.13005831 podStartE2EDuration="2.13005831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:10:51.128068745 +0000 UTC m=+2459.737934474" watchObservedRunningTime="2026-07-28 13:10:51.13005831 +0000 UTC m=+2459.739924017"
Jul 28 13:10:53.559266 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:53.559229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:53.891479 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:53.891384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:54.178010 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.177899    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"]
Jul 28 13:10:54.183711 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.183680    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.187808 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.187781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-e75cd7-openshift-default-dockercfg-92hq7\""
Jul 28 13:10:54.192406 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.192372    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"]
Jul 28 13:10:54.206028 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.205970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:54.307263 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.307220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-socket\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.307479 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.307289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-token\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.307479 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.307340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-credential-socket\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.307479 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.307374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-certs\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.307479 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.307405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b40e5f70-daae-4495-aed0-f10f1a4e6576-istiod-ca-cert\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.307479 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.307451    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-envoy\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.307690 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.307508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-podinfo\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.307690 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.307564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-data\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.307690 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.307625    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbr5b\" (UniqueName: \"kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-kube-api-access-qbr5b\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409073 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-envoy\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409293 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-podinfo\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409293 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-data\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409437 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbr5b\" (UniqueName: \"kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-kube-api-access-qbr5b\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409437 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-socket\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409437 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-token\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409592 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409470    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-credential-socket\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409592 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-certs\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409592 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b40e5f70-daae-4495-aed0-f10f1a4e6576-istiod-ca-cert\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409592 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-data\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409815 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409735    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-socket\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.409993 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.409958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-credential-socket\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.410128 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.410028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-certs\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.410408 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.410387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b40e5f70-daae-4495-aed0-f10f1a4e6576-istiod-ca-cert\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.411621 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.411590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-envoy\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.411860 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.411839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-podinfo\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.417624 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.417595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-token\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.417799 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.417781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbr5b\" (UniqueName: \"kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-kube-api-access-qbr5b\") pod \"e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") " pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.497754 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.497705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:54.654485 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.654447    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"]
Jul 28 13:10:54.657936 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:10:54.657911    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb40e5f70_daae_4495_aed0_f10f1a4e6576.slice/crio-2e91795ecdae5fd30d5c29166ec9d92be2c0a55b0491e05f1b867286c6df89e6 WatchSource:0}: Error finding container 2e91795ecdae5fd30d5c29166ec9d92be2c0a55b0491e05f1b867286c6df89e6: Status 404 returned error can't find the container with id 2e91795ecdae5fd30d5c29166ec9d92be2c0a55b0491e05f1b867286c6df89e6
Jul 28 13:10:54.660698 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.660670    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:10:54.660782 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.660764    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:10:54.660840 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:54.660803    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:10:55.124545 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:55.124499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" event={"ID":"b40e5f70-daae-4495-aed0-f10f1a4e6576","Type":"ContainerStarted","Data":"6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe"}
Jul 28 13:10:55.124767 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:55.124564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" event={"ID":"b40e5f70-daae-4495-aed0-f10f1a4e6576","Type":"ContainerStarted","Data":"2e91795ecdae5fd30d5c29166ec9d92be2c0a55b0491e05f1b867286c6df89e6"}
Jul 28 13:10:55.144321 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:55.144257    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" podStartSLOduration=1.144231195 podStartE2EDuration="1.144231195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:10:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:10:55.143201906 +0000 UTC m=+2463.753067614" watchObservedRunningTime="2026-07-28 13:10:55.144231195 +0000 UTC m=+2463.754096904"
Jul 28 13:10:55.284294 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:55.284259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:55.498225 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:55.498172    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:55.503335 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:55.503303    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:56.129318 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:56.129282    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:56.130296 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:56.130270    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:10:57.154503 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.154464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:57.256842 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.256806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:57.371565 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.371535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:57.572900 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.572843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:57.844012 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.843904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:57.940834 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.940801    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:57.951870 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.951830    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"]
Jul 28 13:10:57.955688 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.955668    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:10:57.958126 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.958094    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-e75cd7-dockercfg-x7vk8\""
Jul 28 13:10:57.958284 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.958089    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-e75cd7\""
Jul 28 13:10:57.964940 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:57.964908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"]
Jul 28 13:10:58.050018 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:58.049036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9380a268-f8b1-40c3-a577-546d2ce9ebc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj\" (UID: \"9380a268-f8b1-40c3-a577-546d2ce9ebc7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:10:58.050018 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:58.049200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm9t2\" (UniqueName: \"kubernetes.io/projected/9380a268-f8b1-40c3-a577-546d2ce9ebc7-kube-api-access-xm9t2\") pod \"payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj\" (UID: \"9380a268-f8b1-40c3-a577-546d2ce9ebc7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:10:58.150147 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:58.150040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm9t2\" (UniqueName: \"kubernetes.io/projected/9380a268-f8b1-40c3-a577-546d2ce9ebc7-kube-api-access-xm9t2\") pod \"payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj\" (UID: \"9380a268-f8b1-40c3-a577-546d2ce9ebc7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:10:58.150147 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:58.150133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9380a268-f8b1-40c3-a577-546d2ce9ebc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj\" (UID: \"9380a268-f8b1-40c3-a577-546d2ce9ebc7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:10:58.150818 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:58.150797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9380a268-f8b1-40c3-a577-546d2ce9ebc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj\" (UID: \"9380a268-f8b1-40c3-a577-546d2ce9ebc7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:10:58.158130 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:58.158099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm9t2\" (UniqueName: \"kubernetes.io/projected/9380a268-f8b1-40c3-a577-546d2ce9ebc7-kube-api-access-xm9t2\") pod \"payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj\" (UID: \"9380a268-f8b1-40c3-a577-546d2ce9ebc7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:10:58.269353 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:58.269309    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:10:58.459659 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:58.459632    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"]
Jul 28 13:10:58.462090 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:10:58.462054    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9380a268_f8b1_40c3_a577_546d2ce9ebc7.slice/crio-14b2eb5de6aea9e9fe8a0a0f22bb75bd558e150a9f2ef7eb0eee17990d607def WatchSource:0}: Error finding container 14b2eb5de6aea9e9fe8a0a0f22bb75bd558e150a9f2ef7eb0eee17990d607def: Status 404 returned error can't find the container with id 14b2eb5de6aea9e9fe8a0a0f22bb75bd558e150a9f2ef7eb0eee17990d607def
Jul 28 13:10:59.147045 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:59.147006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj" event={"ID":"9380a268-f8b1-40c3-a577-546d2ce9ebc7","Type":"ContainerStarted","Data":"eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40"}
Jul 28 13:10:59.147243 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:59.147075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj" event={"ID":"9380a268-f8b1-40c3-a577-546d2ce9ebc7","Type":"ContainerStarted","Data":"14b2eb5de6aea9e9fe8a0a0f22bb75bd558e150a9f2ef7eb0eee17990d607def"}
Jul 28 13:10:59.147243 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:59.147131    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:10:59.164772 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:10:59.164716    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj" podStartSLOduration=2.164698718 podStartE2EDuration="2.164698718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:10:59.163158444 +0000 UTC m=+2467.773024149" watchObservedRunningTime="2026-07-28 13:10:59.164698718 +0000 UTC m=+2467.774564425"
Jul 28 13:11:01.659094 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:01.659060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:11:02.108484 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:02.108449    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:11:02.108669 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:02.108649    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:11:04.124256 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:04.124206    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 13:11:04.124697 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:04.124309    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 13:11:06.189874 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:06.189828    2565 generic.go:356] "Generic (PLEG): container finished" podID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerID="6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952" exitCode=0
Jul 28 13:11:06.190490 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:06.189907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" event={"ID":"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf","Type":"ContainerDied","Data":"6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952"}
Jul 28 13:11:06.190490 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:06.190442    2565 scope.go:117] "RemoveContainer" containerID="6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952"
Jul 28 13:11:06.191824 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:06.191782    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:11:06.191967 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:06.191882    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:11:06.191967 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:06.191931    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:11:07.203226 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:07.203186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" event={"ID":"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf","Type":"ContainerStarted","Data":"c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762"}
Jul 28 13:11:07.349197 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:07.349156    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:11:07.349524 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:07.349497    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 28 13:11:07.349631 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:07.349573    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 28 13:11:08.346795 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:08.346765    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 28 13:11:08.347269 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:08.347245    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 28 13:11:09.346412 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:09.346373    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 28 13:11:09.346673 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:09.346457    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 28 13:11:10.154650 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:10.154614    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:11:10.346693 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:10.346649    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 28 13:11:10.346897 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:10.346717    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 28 13:11:11.347063 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:11.347031    2565 patch_prober.go:28] interesting pod/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 28 13:11:11.347511 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:11.347087    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 28 13:11:12.171211 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:12.171162    2565 patch_prober.go:28] interesting pod/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 13:11:12.172139 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:12.171254    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 13:11:12.350368 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:12.350329    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:11:12.350787 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:12.350592    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:11:12.351284 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:12.351267    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:11:13.131675 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.131639    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"]
Jul 28 13:11:13.134086 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.134063    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.136329 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.136304    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c260d4\"/\"default-dockercfg-ql9vx\""
Jul 28 13:11:13.136876 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.136856    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c260d4\"/\"test-model-c260d4-kserve-self-signed-certs\""
Jul 28 13:11:13.137037 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.136879    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c260d4\"/\"openshift-service-ca.crt\""
Jul 28 13:11:13.137037 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.136924    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c260d4\"/\"kube-root-ca.crt\""
Jul 28 13:11:13.146390 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.146358    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"]
Jul 28 13:11:13.165163 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.165117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:11:13.204443 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.204407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjvdc\" (UniqueName: \"kubernetes.io/projected/06527ea6-35c2-4768-a80b-c99a803e35da-kube-api-access-sjvdc\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.204644 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.204458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-model-cache\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.204644 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.204541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-tmp-dir\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.204644 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.204622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-home\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.204776 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.204660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-dshm\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.204776 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.204687    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06527ea6-35c2-4768-a80b-c99a803e35da-tls-certs\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.240406 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.240374    2565 generic.go:356] "Generic (PLEG): container finished" podID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerID="6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe" exitCode=0
Jul 28 13:11:13.240589 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.240452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" event={"ID":"b40e5f70-daae-4495-aed0-f10f1a4e6576","Type":"ContainerDied","Data":"6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe"}
Jul 28 13:11:13.240949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.240932    2565 scope.go:117] "RemoveContainer" containerID="6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe"
Jul 28 13:11:13.242081 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.242053    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:11:13.242154 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.242138    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:11:13.242204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.242187    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:11:13.305439 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.305404    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-tmp-dir\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.305756 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.305733    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-home\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.305858 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.305799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-dshm\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.305858 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.305821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-tmp-dir\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.305858 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.305839    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06527ea6-35c2-4768-a80b-c99a803e35da-tls-certs\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.306079 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.305923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjvdc\" (UniqueName: \"kubernetes.io/projected/06527ea6-35c2-4768-a80b-c99a803e35da-kube-api-access-sjvdc\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.306079 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.306056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-model-cache\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.306188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.306112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-home\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.306579 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.306555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-model-cache\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.308755 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.308731    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-dshm\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.309465 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.309445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06527ea6-35c2-4768-a80b-c99a803e35da-tls-certs\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.315315 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.315288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjvdc\" (UniqueName: \"kubernetes.io/projected/06527ea6-35c2-4768-a80b-c99a803e35da-kube-api-access-sjvdc\") pod \"test-model-c260d4-kserve-7f4954984c-t69h4\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") " pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.446496 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.446468    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:13.612938 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:13.612910    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"]
Jul 28 13:11:13.615584 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:11:13.615556    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06527ea6_35c2_4768_a80b_c99a803e35da.slice/crio-e8c194d80bd8a84b3a733f6aec2be62855895d681549be2ac883f7ffbf9d5a5d WatchSource:0}: Error finding container e8c194d80bd8a84b3a733f6aec2be62855895d681549be2ac883f7ffbf9d5a5d: Status 404 returned error can't find the container with id e8c194d80bd8a84b3a733f6aec2be62855895d681549be2ac883f7ffbf9d5a5d
Jul 28 13:11:14.248144 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:14.248097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4" event={"ID":"06527ea6-35c2-4768-a80b-c99a803e35da","Type":"ContainerStarted","Data":"f3f79c10ffa4d6b7f841fa12caf71f7b48a832f06a2f7b3f0f9fe1ba5cad1328"}
Jul 28 13:11:14.248144 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:14.248151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4" event={"ID":"06527ea6-35c2-4768-a80b-c99a803e35da","Type":"ContainerStarted","Data":"e8c194d80bd8a84b3a733f6aec2be62855895d681549be2ac883f7ffbf9d5a5d"}
Jul 28 13:11:14.249959 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:14.249931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" event={"ID":"b40e5f70-daae-4495-aed0-f10f1a4e6576","Type":"ContainerStarted","Data":"bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807"}
Jul 28 13:11:14.265069 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:14.265009    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4" podStartSLOduration=1.264971344 podStartE2EDuration="1.264971344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:11:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:11:14.263295946 +0000 UTC m=+2482.873161654" watchObservedRunningTime="2026-07-28 13:11:14.264971344 +0000 UTC m=+2482.874837052"
Jul 28 13:11:14.499242 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:14.499132    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:11:14.499750 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:14.499280    2565 patch_prober.go:28] interesting pod/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 13:11:14.499750 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:14.499326    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 13:11:15.498834 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:15.498790    2565 patch_prober.go:28] interesting pod/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 13:11:15.499172 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:15.499140    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 13:11:16.498344 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:16.498296    2565 patch_prober.go:28] interesting pod/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 13:11:16.498857 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:16.498395    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 13:11:17.499159 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:17.499114    2565 patch_prober.go:28] interesting pod/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 28 13:11:17.499633 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:17.499183    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 28 13:11:18.502082 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:18.502047    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:11:18.502482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:18.502340    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:11:18.503183 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:18.503166    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:11:23.447310 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:23.447269    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:23.447776 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:23.447452    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:23.460270 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:23.460239    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:24.313020 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:24.312961    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:11:36.054896 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:11:36.054855    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:21.447931 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:21.447894    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"]
Jul 28 13:12:21.475192 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:21.475153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:23.210478 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:23.210446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:33.020225 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.020188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:33.053847 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.053810    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"]
Jul 28 13:12:33.054102 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.054078    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99" podUID="ebfcdf26-6108-44b3-a5a6-5438bd00cf71" containerName="payload-processing" containerID="cri-o://697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8" gracePeriod=30
Jul 28 13:12:33.061558 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.061519    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"]
Jul 28 13:12:33.061803 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.061771    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4" podUID="15267f03-d6cc-4de3-96b4-d6353699d3fe" containerName="payload-pre-processing" containerID="cri-o://e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738" gracePeriod=30
Jul 28 13:12:33.090670 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.090626    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:33.161296 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.161258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:33.351678 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.351648    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:12:33.372805 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.372775    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:12:33.410249 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.410213    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15267f03-d6cc-4de3-96b4-d6353699d3fe-plugins-config-volume\") pod \"15267f03-d6cc-4de3-96b4-d6353699d3fe\" (UID: \"15267f03-d6cc-4de3-96b4-d6353699d3fe\") "
Jul 28 13:12:33.410450 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.410261    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-plugins-config-volume\") pod \"ebfcdf26-6108-44b3-a5a6-5438bd00cf71\" (UID: \"ebfcdf26-6108-44b3-a5a6-5438bd00cf71\") "
Jul 28 13:12:33.410450 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.410280    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqbz9\" (UniqueName: \"kubernetes.io/projected/15267f03-d6cc-4de3-96b4-d6353699d3fe-kube-api-access-jqbz9\") pod \"15267f03-d6cc-4de3-96b4-d6353699d3fe\" (UID: \"15267f03-d6cc-4de3-96b4-d6353699d3fe\") "
Jul 28 13:12:33.410450 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.410362    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpgqr\" (UniqueName: \"kubernetes.io/projected/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-kube-api-access-bpgqr\") pod \"ebfcdf26-6108-44b3-a5a6-5438bd00cf71\" (UID: \"ebfcdf26-6108-44b3-a5a6-5438bd00cf71\") "
Jul 28 13:12:33.410735 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.410708    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15267f03-d6cc-4de3-96b4-d6353699d3fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15267f03-d6cc-4de3-96b4-d6353699d3fe" (UID: "15267f03-d6cc-4de3-96b4-d6353699d3fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:12:33.410827 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.410723    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ebfcdf26-6108-44b3-a5a6-5438bd00cf71" (UID: "ebfcdf26-6108-44b3-a5a6-5438bd00cf71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:12:33.412773 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.412742    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15267f03-d6cc-4de3-96b4-d6353699d3fe-kube-api-access-jqbz9" (OuterVolumeSpecName: "kube-api-access-jqbz9") pod "15267f03-d6cc-4de3-96b4-d6353699d3fe" (UID: "15267f03-d6cc-4de3-96b4-d6353699d3fe"). InnerVolumeSpecName "kube-api-access-jqbz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:12:33.412918 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.412775    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-kube-api-access-bpgqr" (OuterVolumeSpecName: "kube-api-access-bpgqr") pod "ebfcdf26-6108-44b3-a5a6-5438bd00cf71" (UID: "ebfcdf26-6108-44b3-a5a6-5438bd00cf71"). InnerVolumeSpecName "kube-api-access-bpgqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:12:33.511845 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.511804    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpgqr\" (UniqueName: \"kubernetes.io/projected/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-kube-api-access-bpgqr\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:33.511845 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.511840    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15267f03-d6cc-4de3-96b4-d6353699d3fe-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:33.511845 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.511849    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebfcdf26-6108-44b3-a5a6-5438bd00cf71-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:33.511845 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.511857    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqbz9\" (UniqueName: \"kubernetes.io/projected/15267f03-d6cc-4de3-96b4-d6353699d3fe-kube-api-access-jqbz9\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:33.662646 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.662549    2565 generic.go:356] "Generic (PLEG): container finished" podID="ebfcdf26-6108-44b3-a5a6-5438bd00cf71" containerID="697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8" exitCode=0
Jul 28 13:12:33.662646 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.662603    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"
Jul 28 13:12:33.662908 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.662642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99" event={"ID":"ebfcdf26-6108-44b3-a5a6-5438bd00cf71","Type":"ContainerDied","Data":"697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8"}
Jul 28 13:12:33.662908 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.662709    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99" event={"ID":"ebfcdf26-6108-44b3-a5a6-5438bd00cf71","Type":"ContainerDied","Data":"faf58ed8875476fac26feef623a0fcbeb6e7c708f58f7b81a6381becdfff01f7"}
Jul 28 13:12:33.662908 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.662739    2565 scope.go:117] "RemoveContainer" containerID="697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8"
Jul 28 13:12:33.664133 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.664111    2565 generic.go:356] "Generic (PLEG): container finished" podID="15267f03-d6cc-4de3-96b4-d6353699d3fe" containerID="e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738" exitCode=0
Jul 28 13:12:33.664246 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.664147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4" event={"ID":"15267f03-d6cc-4de3-96b4-d6353699d3fe","Type":"ContainerDied","Data":"e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738"}
Jul 28 13:12:33.664246 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.664183    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"
Jul 28 13:12:33.664246 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.664193    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4" event={"ID":"15267f03-d6cc-4de3-96b4-d6353699d3fe","Type":"ContainerDied","Data":"6e386999b34a45874fc9cc012bc2d63483827fc1d430420d55c2f7cf555191b1"}
Jul 28 13:12:33.672336 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.672312    2565 scope.go:117] "RemoveContainer" containerID="697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8"
Jul 28 13:12:33.672664 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:12:33.672644    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8\": container with ID starting with 697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8 not found: ID does not exist" containerID="697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8"
Jul 28 13:12:33.672728 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.672673    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8"} err="failed to get container status \"697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8\": rpc error: code = NotFound desc = could not find container \"697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8\": container with ID starting with 697350137d14a974b32f1f70b23fe880ddebc2aa4c638b6700377ff38b0f21f8 not found: ID does not exist"
Jul 28 13:12:33.672728 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.672697    2565 scope.go:117] "RemoveContainer" containerID="e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738"
Jul 28 13:12:33.682163 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.682140    2565 scope.go:117] "RemoveContainer" containerID="e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738"
Jul 28 13:12:33.682486 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:12:33.682467    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738\": container with ID starting with e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738 not found: ID does not exist" containerID="e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738"
Jul 28 13:12:33.682546 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.682495    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738"} err="failed to get container status \"e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738\": rpc error: code = NotFound desc = could not find container \"e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738\": container with ID starting with e7bd6d440a55e686f36aef145906a7a43e13c0115d7ad00e843a1313fec80738 not found: ID does not exist"
Jul 28 13:12:33.689948 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.689916    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"]
Jul 28 13:12:33.693972 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.693942    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c260d4-794fcf8f44-rvh99"]
Jul 28 13:12:33.713787 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.713720    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"]
Jul 28 13:12:33.715666 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.715638    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c260d4-5c58657844-4jnj4"]
Jul 28 13:12:33.900769 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.900729    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15267f03-d6cc-4de3-96b4-d6353699d3fe" path="/var/lib/kubelet/pods/15267f03-d6cc-4de3-96b4-d6353699d3fe/volumes"
Jul 28 13:12:33.901153 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:33.901139    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebfcdf26-6108-44b3-a5a6-5438bd00cf71" path="/var/lib/kubelet/pods/ebfcdf26-6108-44b3-a5a6-5438bd00cf71/volumes"
Jul 28 13:12:36.468508 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.468466    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4" podUID="06527ea6-35c2-4768-a80b-c99a803e35da" containerName="main" containerID="cri-o://f3f79c10ffa4d6b7f841fa12caf71f7b48a832f06a2f7b3f0f9fe1ba5cad1328" gracePeriod=45
Jul 28 13:12:36.683016 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.682964    2565 generic.go:356] "Generic (PLEG): container finished" podID="06527ea6-35c2-4768-a80b-c99a803e35da" containerID="f3f79c10ffa4d6b7f841fa12caf71f7b48a832f06a2f7b3f0f9fe1ba5cad1328" exitCode=0
Jul 28 13:12:36.683016 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.683014    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4" event={"ID":"06527ea6-35c2-4768-a80b-c99a803e35da","Type":"ContainerDied","Data":"f3f79c10ffa4d6b7f841fa12caf71f7b48a832f06a2f7b3f0f9fe1ba5cad1328"}
Jul 28 13:12:36.728625 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.728559    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:12:36.843717 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.843683    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-dshm\") pod \"06527ea6-35c2-4768-a80b-c99a803e35da\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") "
Jul 28 13:12:36.843913 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.843749    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-home\") pod \"06527ea6-35c2-4768-a80b-c99a803e35da\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") "
Jul 28 13:12:36.843913 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.843777    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-model-cache\") pod \"06527ea6-35c2-4768-a80b-c99a803e35da\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") "
Jul 28 13:12:36.843913 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.843810    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjvdc\" (UniqueName: \"kubernetes.io/projected/06527ea6-35c2-4768-a80b-c99a803e35da-kube-api-access-sjvdc\") pod \"06527ea6-35c2-4768-a80b-c99a803e35da\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") "
Jul 28 13:12:36.843913 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.843860    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-tmp-dir\") pod \"06527ea6-35c2-4768-a80b-c99a803e35da\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") "
Jul 28 13:12:36.843913 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.843877    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06527ea6-35c2-4768-a80b-c99a803e35da-tls-certs\") pod \"06527ea6-35c2-4768-a80b-c99a803e35da\" (UID: \"06527ea6-35c2-4768-a80b-c99a803e35da\") "
Jul 28 13:12:36.844232 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.844157    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-model-cache" (OuterVolumeSpecName: "model-cache") pod "06527ea6-35c2-4768-a80b-c99a803e35da" (UID: "06527ea6-35c2-4768-a80b-c99a803e35da"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:12:36.844232 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.844155    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-home" (OuterVolumeSpecName: "home") pod "06527ea6-35c2-4768-a80b-c99a803e35da" (UID: "06527ea6-35c2-4768-a80b-c99a803e35da"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:12:36.844232 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.844169    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "06527ea6-35c2-4768-a80b-c99a803e35da" (UID: "06527ea6-35c2-4768-a80b-c99a803e35da"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:12:36.846303 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.846279    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-dshm" (OuterVolumeSpecName: "dshm") pod "06527ea6-35c2-4768-a80b-c99a803e35da" (UID: "06527ea6-35c2-4768-a80b-c99a803e35da"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:12:36.846388 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.846299    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06527ea6-35c2-4768-a80b-c99a803e35da-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "06527ea6-35c2-4768-a80b-c99a803e35da" (UID: "06527ea6-35c2-4768-a80b-c99a803e35da"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:12:36.846388 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.846377    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06527ea6-35c2-4768-a80b-c99a803e35da-kube-api-access-sjvdc" (OuterVolumeSpecName: "kube-api-access-sjvdc") pod "06527ea6-35c2-4768-a80b-c99a803e35da" (UID: "06527ea6-35c2-4768-a80b-c99a803e35da"). InnerVolumeSpecName "kube-api-access-sjvdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:12:36.944737 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.944699    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjvdc\" (UniqueName: \"kubernetes.io/projected/06527ea6-35c2-4768-a80b-c99a803e35da-kube-api-access-sjvdc\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:36.944737 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.944737    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-tmp-dir\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:36.945016 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.944755    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06527ea6-35c2-4768-a80b-c99a803e35da-tls-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:36.945016 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.944839    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-dshm\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:36.945016 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.944853    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-home\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:36.945016 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:36.944866    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06527ea6-35c2-4768-a80b-c99a803e35da-model-cache\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:37.564436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:37.564402    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:37.692951 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:37.692916    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"
Jul 28 13:12:37.693195 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:37.692949    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4" event={"ID":"06527ea6-35c2-4768-a80b-c99a803e35da","Type":"ContainerDied","Data":"e8c194d80bd8a84b3a733f6aec2be62855895d681549be2ac883f7ffbf9d5a5d"}
Jul 28 13:12:37.693195 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:37.693042    2565 scope.go:117] "RemoveContainer" containerID="f3f79c10ffa4d6b7f841fa12caf71f7b48a832f06a2f7b3f0f9fe1ba5cad1328"
Jul 28 13:12:37.714181 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:37.714139    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"]
Jul 28 13:12:37.717475 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:37.717441    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c260d4/test-model-c260d4-kserve-7f4954984c-t69h4"]
Jul 28 13:12:37.901386 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:37.901279    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06527ea6-35c2-4768-a80b-c99a803e35da" path="/var/lib/kubelet/pods/06527ea6-35c2-4768-a80b-c99a803e35da/volumes"
Jul 28 13:12:37.991765 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:37.991734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:43.776128 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:43.776088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:43.844992 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:43.844941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:44.081487 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:44.081375    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"]
Jul 28 13:12:44.081687 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:44.081659    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy" containerID="cri-o://c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762" gracePeriod=30
Jul 28 13:12:44.103332 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:44.103295    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:44.345085 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:44.344961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:49.334772 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.334745    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:12:49.471368 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471333    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-socket\") pod \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") "
Jul 28 13:12:49.471565 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471406    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istiod-ca-cert\") pod \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") "
Jul 28 13:12:49.471565 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471458    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-data\") pod \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") "
Jul 28 13:12:49.471565 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471523    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-token\") pod \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") "
Jul 28 13:12:49.471707 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471567    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-credential-socket\") pod \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") "
Jul 28 13:12:49.471707 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471608    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-podinfo\") pod \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") "
Jul 28 13:12:49.471707 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471638    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-certs\") pod \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") "
Jul 28 13:12:49.471707 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471663    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-envoy\") pod \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") "
Jul 28 13:12:49.471707 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471695    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" (UID: "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:12:49.472065 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471971    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" (UID: "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:12:49.472065 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.472012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" (UID: "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:12:49.472065 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.472021    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" (UID: "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:12:49.472065 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.471686    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6kln\" (UniqueName: \"kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-kube-api-access-w6kln\") pod \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\" (UID: \"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf\") "
Jul 28 13:12:49.472447 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.472397    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:49.472447 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.472423    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:49.472447 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.472437    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:49.472447 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.472450    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:49.472793 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.472609    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" (UID: "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:12:49.474253 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.474217    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" (UID: "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:12:49.474375 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.474337    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-kube-api-access-w6kln" (OuterVolumeSpecName: "kube-api-access-w6kln") pod "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" (UID: "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf"). InnerVolumeSpecName "kube-api-access-w6kln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:12:49.474522 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.474502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" (UID: "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:12:49.474601 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.474583    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" (UID: "b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:12:49.573030 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.572963    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:49.573030 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.573032    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:49.573248 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.573047    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:49.573248 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.573060    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:49.573248 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.573075    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6kln\" (UniqueName: \"kubernetes.io/projected/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf-kube-api-access-w6kln\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:49.758645 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.758547    2565 generic.go:356] "Generic (PLEG): container finished" podID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerID="c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762" exitCode=0
Jul 28 13:12:49.758645 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.758593    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"
Jul 28 13:12:49.758645 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.758631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" event={"ID":"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf","Type":"ContainerDied","Data":"c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762"}
Jul 28 13:12:49.758926 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.758682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4" event={"ID":"b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf","Type":"ContainerDied","Data":"c885629035eab474861be67862857156295b53c6dc59d1d5ba33368a8e3d5e90"}
Jul 28 13:12:49.758926 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.758704    2565 scope.go:117] "RemoveContainer" containerID="c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762"
Jul 28 13:12:49.769093 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.769064    2565 scope.go:117] "RemoveContainer" containerID="6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952"
Jul 28 13:12:49.778687 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.778624    2565 scope.go:117] "RemoveContainer" containerID="c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762"
Jul 28 13:12:49.779086 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:12:49.779061    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762\": container with ID starting with c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762 not found: ID does not exist" containerID="c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762"
Jul 28 13:12:49.779195 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.779094    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762"} err="failed to get container status \"c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762\": rpc error: code = NotFound desc = could not find container \"c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762\": container with ID starting with c59e9aca55a04e626f98e0061ffa5fa6484a553d33fc569c08a5638f2531e762 not found: ID does not exist"
Jul 28 13:12:49.779195 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.779121    2565 scope.go:117] "RemoveContainer" containerID="6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952"
Jul 28 13:12:49.779390 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:12:49.779372    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952\": container with ID starting with 6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952 not found: ID does not exist" containerID="6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952"
Jul 28 13:12:49.779434 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.779399    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952"} err="failed to get container status \"6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952\": rpc error: code = NotFound desc = could not find container \"6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952\": container with ID starting with 6e9426c8a9f0ae081d34c64317035ea017c573c264199c6906a9579e14e15952 not found: ID does not exist"
Jul 28 13:12:49.780793 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.780772    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"]
Jul 28 13:12:49.787220 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.787192    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c260d4-openshift-default-64d48468f6-5vzk4"]
Jul 28 13:12:49.901902 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:49.901863    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" path="/var/lib/kubelet/pods/b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf/volumes"
Jul 28 13:12:54.873681 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:54.873643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:54.901313 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:54.901277    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"]
Jul 28 13:12:54.901583 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:54.901556    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj" podUID="9380a268-f8b1-40c3-a577-546d2ce9ebc7" containerName="payload-pre-processing" containerID="cri-o://eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40" gracePeriod=30
Jul 28 13:12:54.972852 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:54.972824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:55.025827 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.025789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:55.164626 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.164590    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:12:55.330651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.330620    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9380a268-f8b1-40c3-a577-546d2ce9ebc7-plugins-config-volume\") pod \"9380a268-f8b1-40c3-a577-546d2ce9ebc7\" (UID: \"9380a268-f8b1-40c3-a577-546d2ce9ebc7\") "
Jul 28 13:12:55.330848 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.330707    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm9t2\" (UniqueName: \"kubernetes.io/projected/9380a268-f8b1-40c3-a577-546d2ce9ebc7-kube-api-access-xm9t2\") pod \"9380a268-f8b1-40c3-a577-546d2ce9ebc7\" (UID: \"9380a268-f8b1-40c3-a577-546d2ce9ebc7\") "
Jul 28 13:12:55.331068 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.331043    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9380a268-f8b1-40c3-a577-546d2ce9ebc7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9380a268-f8b1-40c3-a577-546d2ce9ebc7" (UID: "9380a268-f8b1-40c3-a577-546d2ce9ebc7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:12:55.333020 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.332965    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9380a268-f8b1-40c3-a577-546d2ce9ebc7-kube-api-access-xm9t2" (OuterVolumeSpecName: "kube-api-access-xm9t2") pod "9380a268-f8b1-40c3-a577-546d2ce9ebc7" (UID: "9380a268-f8b1-40c3-a577-546d2ce9ebc7"). InnerVolumeSpecName "kube-api-access-xm9t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:12:55.432091 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.431973    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9380a268-f8b1-40c3-a577-546d2ce9ebc7-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:55.432091 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.432031    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm9t2\" (UniqueName: \"kubernetes.io/projected/9380a268-f8b1-40c3-a577-546d2ce9ebc7-kube-api-access-xm9t2\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:12:55.791446 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.791407    2565 generic.go:356] "Generic (PLEG): container finished" podID="9380a268-f8b1-40c3-a577-546d2ce9ebc7" containerID="eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40" exitCode=0
Jul 28 13:12:55.791646 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.791457    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"
Jul 28 13:12:55.791646 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.791499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj" event={"ID":"9380a268-f8b1-40c3-a577-546d2ce9ebc7","Type":"ContainerDied","Data":"eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40"}
Jul 28 13:12:55.791646 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.791555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj" event={"ID":"9380a268-f8b1-40c3-a577-546d2ce9ebc7","Type":"ContainerDied","Data":"14b2eb5de6aea9e9fe8a0a0f22bb75bd558e150a9f2ef7eb0eee17990d607def"}
Jul 28 13:12:55.791646 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.791581    2565 scope.go:117] "RemoveContainer" containerID="eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40"
Jul 28 13:12:55.801093 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.801070    2565 scope.go:117] "RemoveContainer" containerID="eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40"
Jul 28 13:12:55.801397 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:12:55.801378    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40\": container with ID starting with eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40 not found: ID does not exist" containerID="eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40"
Jul 28 13:12:55.801490 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.801419    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40"} err="failed to get container status \"eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40\": rpc error: code = NotFound desc = could not find container \"eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40\": container with ID starting with eb69191e2d40d651034d40b733c1e71847e1ef71ddf2d50f6dbbbcd3e51a7f40 not found: ID does not exist"
Jul 28 13:12:55.811599 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.811562    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"]
Jul 28 13:12:55.815701 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.815670    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e75cd7-8445fb7b5b-dctnj"]
Jul 28 13:12:55.900175 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:55.900132    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9380a268-f8b1-40c3-a577-546d2ce9ebc7" path="/var/lib/kubelet/pods/9380a268-f8b1-40c3-a577-546d2ce9ebc7/volumes"
Jul 28 13:12:59.542594 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:12:59.542544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:00.083790 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:00.083718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:05.720266 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:05.720212    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:05.820119 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:05.820069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:06.019018 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:06.018890    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"]
Jul 28 13:13:06.019211 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:06.019179    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy" containerID="cri-o://bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807" gracePeriod=30
Jul 28 13:13:06.041949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:06.041908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:06.297631 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:06.297542    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:06.742074 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:06.742039    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:07.088103 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088007    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"]
Jul 28 13:13:07.088396 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088382    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15267f03-d6cc-4de3-96b4-d6353699d3fe" containerName="payload-pre-processing"
Jul 28 13:13:07.088448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088398    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="15267f03-d6cc-4de3-96b4-d6353699d3fe" containerName="payload-pre-processing"
Jul 28 13:13:07.088448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088408    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9380a268-f8b1-40c3-a577-546d2ce9ebc7" containerName="payload-pre-processing"
Jul 28 13:13:07.088448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088414    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9380a268-f8b1-40c3-a577-546d2ce9ebc7" containerName="payload-pre-processing"
Jul 28 13:13:07.088448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088425    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06527ea6-35c2-4768-a80b-c99a803e35da" containerName="main"
Jul 28 13:13:07.088448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088431    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="06527ea6-35c2-4768-a80b-c99a803e35da" containerName="main"
Jul 28 13:13:07.088448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088447    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy"
Jul 28 13:13:07.088633 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088452    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy"
Jul 28 13:13:07.088633 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088468    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebfcdf26-6108-44b3-a5a6-5438bd00cf71" containerName="payload-processing"
Jul 28 13:13:07.088633 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088474    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebfcdf26-6108-44b3-a5a6-5438bd00cf71" containerName="payload-processing"
Jul 28 13:13:07.088633 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088543    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy"
Jul 28 13:13:07.088633 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088550    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="15267f03-d6cc-4de3-96b4-d6353699d3fe" containerName="payload-pre-processing"
Jul 28 13:13:07.088633 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088556    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9380a268-f8b1-40c3-a577-546d2ce9ebc7" containerName="payload-pre-processing"
Jul 28 13:13:07.088633 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088564    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebfcdf26-6108-44b3-a5a6-5438bd00cf71" containerName="payload-processing"
Jul 28 13:13:07.088633 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088569    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy"
Jul 28 13:13:07.088633 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.088575    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="06527ea6-35c2-4768-a80b-c99a803e35da" containerName="main"
Jul 28 13:13:07.091972 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.091950    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.095047 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.095009    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-12b3e2-openshift-default-dockercfg-4mblc\""
Jul 28 13:13:07.104230 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.104199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"]
Jul 28 13:13:07.119388 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.119358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:07.145596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.145552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-envoy\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.145816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.145604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-data\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.145816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.145629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-credential-socket\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.145816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.145680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a825db5-10f4-4288-9018-af25243a5059-istiod-ca-cert\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.145816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.145704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-socket\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.145816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.145727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a825db5-10f4-4288-9018-af25243a5059-istio-podinfo\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.145816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.145763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4n7z\" (UniqueName: \"kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-kube-api-access-x4n7z\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.145816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.145800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-certs\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.146172 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.145832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-istio-token\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.233247 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.233211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:07.246456 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.246417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-envoy\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.246456 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.246463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-data\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.246721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.246482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-credential-socket\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.246721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.246504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a825db5-10f4-4288-9018-af25243a5059-istiod-ca-cert\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.246721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.246527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-socket\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.246721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.246650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a825db5-10f4-4288-9018-af25243a5059-istio-podinfo\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.246721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.246686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4n7z\" (UniqueName: \"kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-kube-api-access-x4n7z\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.246721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.246717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-certs\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.247060 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.246761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-istio-token\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.247060 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.246893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-data\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.247183 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.247053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-credential-socket\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.247245 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.247204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-certs\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.247307 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.247274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-socket\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.247421 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.247398    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a825db5-10f4-4288-9018-af25243a5059-istiod-ca-cert\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.249135 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.249117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-envoy\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.249333 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.249315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a825db5-10f4-4288-9018-af25243a5059-istio-podinfo\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.256466 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.256434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-istio-token\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.256687 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.256670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4n7z\" (UniqueName: \"kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-kube-api-access-x4n7z\") pod \"e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") " pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.404259 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.404145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:07.557250 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.557222    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"]
Jul 28 13:13:07.559460 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:13:07.559429    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a825db5_10f4_4288_9018_af25243a5059.slice/crio-ba2abb326a0830dec99920015e8a1001b78be16587ffcdf83a0d8d507f8d5ee9 WatchSource:0}: Error finding container ba2abb326a0830dec99920015e8a1001b78be16587ffcdf83a0d8d507f8d5ee9: Status 404 returned error can't find the container with id ba2abb326a0830dec99920015e8a1001b78be16587ffcdf83a0d8d507f8d5ee9
Jul 28 13:13:07.562101 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.562071    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:07.562182 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.562158    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:07.562226 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.562187    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:07.857769 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.857724    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" event={"ID":"5a825db5-10f4-4288-9018-af25243a5059","Type":"ContainerStarted","Data":"9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691"}
Jul 28 13:13:07.858288 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.857782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" event={"ID":"5a825db5-10f4-4288-9018-af25243a5059","Type":"ContainerStarted","Data":"ba2abb326a0830dec99920015e8a1001b78be16587ffcdf83a0d8d507f8d5ee9"}
Jul 28 13:13:07.880693 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:07.880625    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" podStartSLOduration=0.880604713 podStartE2EDuration="880.604713ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:13:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:13:07.878687979 +0000 UTC m=+2596.488553708" watchObservedRunningTime="2026-07-28 13:13:07.880604713 +0000 UTC m=+2596.490470423"
Jul 28 13:13:08.405055 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:08.405012    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:08.406637 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:08.406601    2565 patch_prober.go:28] interesting pod/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 28 13:13:08.406781 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:08.406670    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 28 13:13:09.410279 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:09.410242    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:09.867920 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:09.867882    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:09.869023 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:09.868969    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:09.898849 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:09.898785    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:09.987258 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:09.987219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:10.060301 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.060262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:10.455464 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.455424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:10.664527 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.664493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:10.758655 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.758573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:10.759387 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.759367    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"]
Jul 28 13:13:10.759782 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.759768    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy"
Jul 28 13:13:10.759833 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.759784    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b884e2cf-85ef-4bcb-bcbb-13a24df0d9cf" containerName="istio-proxy"
Jul 28 13:13:10.763129 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.763109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:10.766329 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.766281    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-12b3e2-dockercfg-ffw7s\""
Jul 28 13:13:10.766482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.766440    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-12b3e2\""
Jul 28 13:13:10.777919 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.777887    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"]
Jul 28 13:13:10.784144 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.784114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm5zr\" (UniqueName: \"kubernetes.io/projected/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-kube-api-access-mm5zr\") pod \"payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc\" (UID: \"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:10.784303 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.784181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc\" (UID: \"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:10.797836 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.797803    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"]
Jul 28 13:13:10.801206 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.801185    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:10.816525 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.816493    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"]
Jul 28 13:13:10.885769 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.885735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm5zr\" (UniqueName: \"kubernetes.io/projected/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-kube-api-access-mm5zr\") pod \"payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc\" (UID: \"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:10.885769 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.885782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpwm9\" (UniqueName: \"kubernetes.io/projected/e2db2848-763a-449f-b119-ec1fd166cb9e-kube-api-access-kpwm9\") pod \"payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx\" (UID: \"e2db2848-763a-449f-b119-ec1fd166cb9e\") " pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:10.886075 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.885816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2db2848-763a-449f-b119-ec1fd166cb9e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx\" (UID: \"e2db2848-763a-449f-b119-ec1fd166cb9e\") " pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:10.886075 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.885936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc\" (UID: \"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:10.886591 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.886570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc\" (UID: \"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:10.894493 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.894454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm5zr\" (UniqueName: \"kubernetes.io/projected/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-kube-api-access-mm5zr\") pod \"payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc\" (UID: \"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:10.987057 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.987005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpwm9\" (UniqueName: \"kubernetes.io/projected/e2db2848-763a-449f-b119-ec1fd166cb9e-kube-api-access-kpwm9\") pod \"payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx\" (UID: \"e2db2848-763a-449f-b119-ec1fd166cb9e\") " pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:10.987256 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.987066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2db2848-763a-449f-b119-ec1fd166cb9e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx\" (UID: \"e2db2848-763a-449f-b119-ec1fd166cb9e\") " pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:10.987835 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.987809    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2db2848-763a-449f-b119-ec1fd166cb9e-plugins-config-volume\") pod \"payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx\" (UID: \"e2db2848-763a-449f-b119-ec1fd166cb9e\") " pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:10.997136 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:10.997105    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpwm9\" (UniqueName: \"kubernetes.io/projected/e2db2848-763a-449f-b119-ec1fd166cb9e-kube-api-access-kpwm9\") pod \"payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx\" (UID: \"e2db2848-763a-449f-b119-ec1fd166cb9e\") " pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:11.074708 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.074674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:11.111905 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.111863    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:11.238259 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.238126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"]
Jul 28 13:13:11.241307 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:13:11.241265    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd04ff43_12e7_413f_bf3b_b6ec4ba778e1.slice/crio-383d54758ec927eaa6fd7ec90a33197186bf47c021286ff22b4338169641234a WatchSource:0}: Error finding container 383d54758ec927eaa6fd7ec90a33197186bf47c021286ff22b4338169641234a: Status 404 returned error can't find the container with id 383d54758ec927eaa6fd7ec90a33197186bf47c021286ff22b4338169641234a
Jul 28 13:13:11.307029 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.307003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"]
Jul 28 13:13:11.308918 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:13:11.308886    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2db2848_763a_449f_b119_ec1fd166cb9e.slice/crio-218990ac7c1e9335b2a35c03bbde146375b9c651832995d28b6f14325be6c5f4 WatchSource:0}: Error finding container 218990ac7c1e9335b2a35c03bbde146375b9c651832995d28b6f14325be6c5f4: Status 404 returned error can't find the container with id 218990ac7c1e9335b2a35c03bbde146375b9c651832995d28b6f14325be6c5f4
Jul 28 13:13:11.310599 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.310577    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:13:11.389942 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.389911    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-data\") pod \"b40e5f70-daae-4495-aed0-f10f1a4e6576\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") "
Jul 28 13:13:11.390181 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.389973    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-certs\") pod \"b40e5f70-daae-4495-aed0-f10f1a4e6576\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") "
Jul 28 13:13:11.390181 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390044    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b40e5f70-daae-4495-aed0-f10f1a4e6576-istiod-ca-cert\") pod \"b40e5f70-daae-4495-aed0-f10f1a4e6576\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") "
Jul 28 13:13:11.390181 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390095    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-token\") pod \"b40e5f70-daae-4495-aed0-f10f1a4e6576\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") "
Jul 28 13:13:11.390181 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-podinfo\") pod \"b40e5f70-daae-4495-aed0-f10f1a4e6576\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") "
Jul 28 13:13:11.390181 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390162    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbr5b\" (UniqueName: \"kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-kube-api-access-qbr5b\") pod \"b40e5f70-daae-4495-aed0-f10f1a4e6576\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") "
Jul 28 13:13:11.390460 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390202    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-socket\") pod \"b40e5f70-daae-4495-aed0-f10f1a4e6576\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") "
Jul 28 13:13:11.390460 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390237    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-envoy\") pod \"b40e5f70-daae-4495-aed0-f10f1a4e6576\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") "
Jul 28 13:13:11.390460 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390238    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b40e5f70-daae-4495-aed0-f10f1a4e6576" (UID: "b40e5f70-daae-4495-aed0-f10f1a4e6576"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:13:11.390460 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390284    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-credential-socket\") pod \"b40e5f70-daae-4495-aed0-f10f1a4e6576\" (UID: \"b40e5f70-daae-4495-aed0-f10f1a4e6576\") "
Jul 28 13:13:11.390661 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390486    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b40e5f70-daae-4495-aed0-f10f1a4e6576-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b40e5f70-daae-4495-aed0-f10f1a4e6576" (UID: "b40e5f70-daae-4495-aed0-f10f1a4e6576"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:13:11.390725 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390686    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-data" (OuterVolumeSpecName: "istio-data") pod "b40e5f70-daae-4495-aed0-f10f1a4e6576" (UID: "b40e5f70-daae-4495-aed0-f10f1a4e6576"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:13:11.390801 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390773    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:11.390801 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390792    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b40e5f70-daae-4495-aed0-f10f1a4e6576-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:11.390911 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390866    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b40e5f70-daae-4495-aed0-f10f1a4e6576" (UID: "b40e5f70-daae-4495-aed0-f10f1a4e6576"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:13:11.390995 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.390927    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b40e5f70-daae-4495-aed0-f10f1a4e6576" (UID: "b40e5f70-daae-4495-aed0-f10f1a4e6576"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:13:11.393448 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.393385    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b40e5f70-daae-4495-aed0-f10f1a4e6576" (UID: "b40e5f70-daae-4495-aed0-f10f1a4e6576"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:13:11.393616 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.393498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-kube-api-access-qbr5b" (OuterVolumeSpecName: "kube-api-access-qbr5b") pod "b40e5f70-daae-4495-aed0-f10f1a4e6576" (UID: "b40e5f70-daae-4495-aed0-f10f1a4e6576"). InnerVolumeSpecName "kube-api-access-qbr5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:13:11.393616 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.393543    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-token" (OuterVolumeSpecName: "istio-token") pod "b40e5f70-daae-4495-aed0-f10f1a4e6576" (UID: "b40e5f70-daae-4495-aed0-f10f1a4e6576"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:13:11.393616 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.393592    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b40e5f70-daae-4495-aed0-f10f1a4e6576" (UID: "b40e5f70-daae-4495-aed0-f10f1a4e6576"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:13:11.492327 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.492289    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:11.492327 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.492325    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:11.492327 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.492336    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:11.492799 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.492344    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:11.492799 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.492353    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:11.492799 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.492360    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b40e5f70-daae-4495-aed0-f10f1a4e6576-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:11.492799 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.492368    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbr5b\" (UniqueName: \"kubernetes.io/projected/b40e5f70-daae-4495-aed0-f10f1a4e6576-kube-api-access-qbr5b\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:11.882687 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.882651    2565 generic.go:356] "Generic (PLEG): container finished" podID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerID="bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807" exitCode=0
Jul 28 13:13:11.882866 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.882714    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"
Jul 28 13:13:11.882866 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.882735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" event={"ID":"b40e5f70-daae-4495-aed0-f10f1a4e6576","Type":"ContainerDied","Data":"bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807"}
Jul 28 13:13:11.882866 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.882798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf" event={"ID":"b40e5f70-daae-4495-aed0-f10f1a4e6576","Type":"ContainerDied","Data":"2e91795ecdae5fd30d5c29166ec9d92be2c0a55b0491e05f1b867286c6df89e6"}
Jul 28 13:13:11.882866 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.882816    2565 scope.go:117] "RemoveContainer" containerID="bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807"
Jul 28 13:13:11.884812 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.884782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx" event={"ID":"e2db2848-763a-449f-b119-ec1fd166cb9e","Type":"ContainerStarted","Data":"3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e"}
Jul 28 13:13:11.884941 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.884836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx" event={"ID":"e2db2848-763a-449f-b119-ec1fd166cb9e","Type":"ContainerStarted","Data":"218990ac7c1e9335b2a35c03bbde146375b9c651832995d28b6f14325be6c5f4"}
Jul 28 13:13:11.884941 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.884896    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:11.886673 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.886580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc" event={"ID":"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1","Type":"ContainerStarted","Data":"1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a"}
Jul 28 13:13:11.886673 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.886640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc" event={"ID":"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1","Type":"ContainerStarted","Data":"383d54758ec927eaa6fd7ec90a33197186bf47c021286ff22b4338169641234a"}
Jul 28 13:13:11.894372 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.894339    2565 scope.go:117] "RemoveContainer" containerID="6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe"
Jul 28 13:13:11.903739 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.903448    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx" podStartSLOduration=1.903430221 podStartE2EDuration="1.903430221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:13:11.901253118 +0000 UTC m=+2600.511118826" watchObservedRunningTime="2026-07-28 13:13:11.903430221 +0000 UTC m=+2600.513295929"
Jul 28 13:13:11.915327 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.915304    2565 scope.go:117] "RemoveContainer" containerID="bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807"
Jul 28 13:13:11.915709 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:13:11.915679    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807\": container with ID starting with bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807 not found: ID does not exist" containerID="bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807"
Jul 28 13:13:11.915788 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.915725    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807"} err="failed to get container status \"bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807\": rpc error: code = NotFound desc = could not find container \"bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807\": container with ID starting with bb3b1f536c99023887f638c24aa10ee63bbfe2a780cc0d0017e7427c47692807 not found: ID does not exist"
Jul 28 13:13:11.915788 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.915751    2565 scope.go:117] "RemoveContainer" containerID="6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe"
Jul 28 13:13:11.916109 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:13:11.916091    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe\": container with ID starting with 6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe not found: ID does not exist" containerID="6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe"
Jul 28 13:13:11.916164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.916117    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe"} err="failed to get container status \"6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe\": rpc error: code = NotFound desc = could not find container \"6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe\": container with ID starting with 6fb0655ea3e413e4bdffe4226ac91622b5bf0ed291962f4570f1a8e6b5bee6fe not found: ID does not exist"
Jul 28 13:13:11.919071 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.919024    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc" podStartSLOduration=1.91900716 podStartE2EDuration="1.91900716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:13:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:13:11.917648986 +0000 UTC m=+2600.527514694" watchObservedRunningTime="2026-07-28 13:13:11.91900716 +0000 UTC m=+2600.528872862"
Jul 28 13:13:11.938218 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.938179    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"]
Jul 28 13:13:11.944178 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:11.944137    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-e75cd7-openshift-default-c57b48858-sdgnf"]
Jul 28 13:13:12.892913 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:12.892830    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:13.901672 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:13.901638    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" path="/var/lib/kubelet/pods/b40e5f70-daae-4495-aed0-f10f1a4e6576/volumes"
Jul 28 13:13:14.451685 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:14.451645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:14.952046 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:14.952015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:15.235025 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.234921    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"]
Jul 28 13:13:15.235529 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.235512    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy"
Jul 28 13:13:15.235584 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.235533    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy"
Jul 28 13:13:15.235584 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.235558    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy"
Jul 28 13:13:15.235584 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.235567    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy"
Jul 28 13:13:15.235686 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.235662    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy"
Jul 28 13:13:15.235686 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.235674    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b40e5f70-daae-4495-aed0-f10f1a4e6576" containerName="istio-proxy"
Jul 28 13:13:15.240620 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.240593    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.242614 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.242593    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-bec5cf-openshift-default-dockercfg-7z27r\""
Jul 28 13:13:15.249221 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.248931    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"]
Jul 28 13:13:15.268916 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.268877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:15.329720 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.329670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-socket\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.329937 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.329805    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-data\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.329937 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.329864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-credential-socket\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.329937 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.329897    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-token\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.330164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.329941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-certs\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.330164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.329991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-envoy\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.330164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.330052    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-podinfo\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.330164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.330086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfbbf371-f71d-4025-8b84-2285c047d9a9-istiod-ca-cert\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.330164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.330117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blvvd\" (UniqueName: \"kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-kube-api-access-blvvd\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431184 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-data\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431184 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-credential-socket\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-token\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-certs\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-envoy\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-podinfo\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431304    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfbbf371-f71d-4025-8b84-2285c047d9a9-istiod-ca-cert\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431335    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blvvd\" (UniqueName: \"kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-kube-api-access-blvvd\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431436 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431418    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-socket\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431828 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-socket\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.431936 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.431921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-data\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.432097 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.432076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-credential-socket\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.432172 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.432134    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-certs\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.432372 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.432350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfbbf371-f71d-4025-8b84-2285c047d9a9-istiod-ca-cert\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.434638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.434610    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-envoy\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.434809 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.434790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-podinfo\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.439077 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.439053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-token\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.439176 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.439139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blvvd\" (UniqueName: \"kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-kube-api-access-blvvd\") pod \"e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") " pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.553294 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.553177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:15.713454 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.713397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:15.766226 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.766197    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"]
Jul 28 13:13:15.768095 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:13:15.768063    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfbbf371_f71d_4025_8b84_2285c047d9a9.slice/crio-94336f0573517ef288b7a11b2eea4fdaac41d5e3b88f2025228e8b7ff371a720 WatchSource:0}: Error finding container 94336f0573517ef288b7a11b2eea4fdaac41d5e3b88f2025228e8b7ff371a720: Status 404 returned error can't find the container with id 94336f0573517ef288b7a11b2eea4fdaac41d5e3b88f2025228e8b7ff371a720
Jul 28 13:13:15.770631 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.770601    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:15.770734 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.770672    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:15.770734 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.770723    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:15.918452 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.918412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" event={"ID":"cfbbf371-f71d-4025-8b84-2285c047d9a9","Type":"ContainerStarted","Data":"3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe"}
Jul 28 13:13:15.918664 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.918480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" event={"ID":"cfbbf371-f71d-4025-8b84-2285c047d9a9","Type":"ContainerStarted","Data":"94336f0573517ef288b7a11b2eea4fdaac41d5e3b88f2025228e8b7ff371a720"}
Jul 28 13:13:15.937674 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:15.937615    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" podStartSLOduration=0.937597591 podStartE2EDuration="937.597591ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:13:15.935789645 +0000 UTC m=+2604.545655381" watchObservedRunningTime="2026-07-28 13:13:15.937597591 +0000 UTC m=+2604.547463299"
Jul 28 13:13:16.553378 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:16.553334    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:16.559016 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:16.558957    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:16.924051 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:16.923927    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:16.925048 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:16.925028    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:17.953820 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:17.953786    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:18.042456 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.042409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:18.124936 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.124902    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:18.646154 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.646113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:18.718095 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.718059    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:18.722273 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.722226    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"]
Jul 28 13:13:18.726192 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.726166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:13:18.729805 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.729770    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-bec5cf-dockercfg-l8mhf\""
Jul 28 13:13:18.730042 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.730025    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-bec5cf\""
Jul 28 13:13:18.737938 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.737908    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"]
Jul 28 13:13:18.761917 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.761877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8dvr\" (UniqueName: \"kubernetes.io/projected/40c006cc-a04f-48d5-b1ef-dd50f92cb842-kube-api-access-k8dvr\") pod \"payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv\" (UID: \"40c006cc-a04f-48d5-b1ef-dd50f92cb842\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:13:18.762117 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.761946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40c006cc-a04f-48d5-b1ef-dd50f92cb842-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv\" (UID: \"40c006cc-a04f-48d5-b1ef-dd50f92cb842\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:13:18.862863 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.862823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8dvr\" (UniqueName: \"kubernetes.io/projected/40c006cc-a04f-48d5-b1ef-dd50f92cb842-kube-api-access-k8dvr\") pod \"payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv\" (UID: \"40c006cc-a04f-48d5-b1ef-dd50f92cb842\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:13:18.862863 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.862884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40c006cc-a04f-48d5-b1ef-dd50f92cb842-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv\" (UID: \"40c006cc-a04f-48d5-b1ef-dd50f92cb842\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:13:18.863658 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.863634    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40c006cc-a04f-48d5-b1ef-dd50f92cb842-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv\" (UID: \"40c006cc-a04f-48d5-b1ef-dd50f92cb842\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:13:18.871104 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:18.871070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8dvr\" (UniqueName: \"kubernetes.io/projected/40c006cc-a04f-48d5-b1ef-dd50f92cb842-kube-api-access-k8dvr\") pod \"payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv\" (UID: \"40c006cc-a04f-48d5-b1ef-dd50f92cb842\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:13:19.041322 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:19.041283    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:13:19.195344 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:19.195304    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:19.201313 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:19.201219    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"]
Jul 28 13:13:19.204060 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:13:19.204034    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c006cc_a04f_48d5_b1ef_dd50f92cb842.slice/crio-7ea2efc7290e76fb1ea25ae9d0c787db7c2979241987f930633ab8aced48d7d9 WatchSource:0}: Error finding container 7ea2efc7290e76fb1ea25ae9d0c787db7c2979241987f930633ab8aced48d7d9: Status 404 returned error can't find the container with id 7ea2efc7290e76fb1ea25ae9d0c787db7c2979241987f930633ab8aced48d7d9
Jul 28 13:13:19.941055 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:19.941021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv" event={"ID":"40c006cc-a04f-48d5-b1ef-dd50f92cb842","Type":"ContainerStarted","Data":"9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd"}
Jul 28 13:13:19.941257 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:19.941075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv" event={"ID":"40c006cc-a04f-48d5-b1ef-dd50f92cb842","Type":"ContainerStarted","Data":"7ea2efc7290e76fb1ea25ae9d0c787db7c2979241987f930633ab8aced48d7d9"}
Jul 28 13:13:19.941257 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:19.941161    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:13:19.958531 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:19.958229    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv" podStartSLOduration=1.958211886 podStartE2EDuration="1.958211886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:13:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:13:19.95799429 +0000 UTC m=+2608.567859990" watchObservedRunningTime="2026-07-28 13:13:19.958211886 +0000 UTC m=+2608.568077593"
Jul 28 13:13:21.956503 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:21.956409    2565 generic.go:356] "Generic (PLEG): container finished" podID="5a825db5-10f4-4288-9018-af25243a5059" containerID="9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691" exitCode=0
Jul 28 13:13:21.956503 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:21.956488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" event={"ID":"5a825db5-10f4-4288-9018-af25243a5059","Type":"ContainerDied","Data":"9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691"}
Jul 28 13:13:21.957023 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:21.956973    2565 scope.go:117] "RemoveContainer" containerID="9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691"
Jul 28 13:13:21.958140 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:21.958118    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:21.958204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:21.958182    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:21.958240 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:21.958216    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:22.484179 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:22.484141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:22.897366 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:22.897266    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:22.964304 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:22.964274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" event={"ID":"5a825db5-10f4-4288-9018-af25243a5059","Type":"ContainerStarted","Data":"23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161"}
Jul 28 13:13:23.404917 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:23.404760    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:23.406926 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:23.406893    2565 patch_prober.go:28] interesting pod/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 28 13:13:23.407215 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:23.407173    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 28 13:13:23.906365 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:23.906322    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:24.405149 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:24.405098    2565 patch_prober.go:28] interesting pod/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 28 13:13:24.405729 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:24.405171    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 28 13:13:24.868255 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:24.868196    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:25.405261 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:25.404770    2565 patch_prober.go:28] interesting pod/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 28 13:13:25.405261 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:25.404837    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 28 13:13:26.404950 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:26.404901    2565 patch_prober.go:28] interesting pod/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 28 13:13:26.405297 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:26.405000    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 28 13:13:27.409684 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:27.409653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:27.410954 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:27.410932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:13:30.961106 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:30.961068    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:13:31.016896 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:31.016864    2565 generic.go:356] "Generic (PLEG): container finished" podID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerID="3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe" exitCode=0
Jul 28 13:13:31.017129 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:31.016940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" event={"ID":"cfbbf371-f71d-4025-8b84-2285c047d9a9","Type":"ContainerDied","Data":"3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe"}
Jul 28 13:13:31.017469 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:31.017452    2565 scope.go:117] "RemoveContainer" containerID="3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe"
Jul 28 13:13:31.018651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:31.018623    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:31.018718 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:31.018697    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:31.018753 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:31.018733    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:13:31.924638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:31.924591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:32.026532 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:32.026494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" event={"ID":"cfbbf371-f71d-4025-8b84-2285c047d9a9","Type":"ContainerStarted","Data":"02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a"}
Jul 28 13:13:32.553393 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:32.553357    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:32.554596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:32.554564    2565 patch_prober.go:28] interesting pod/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 28 13:13:32.554749 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:32.554618    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 28 13:13:33.554594 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:33.554554    2565 patch_prober.go:28] interesting pod/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 28 13:13:33.555017 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:33.554610    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 28 13:13:34.554119 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:34.554079    2565 patch_prober.go:28] interesting pod/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 28 13:13:34.554386 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:34.554152    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 28 13:13:35.554527 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:35.554490    2565 patch_prober.go:28] interesting pod/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 28 13:13:35.554933 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:35.554552    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 28 13:13:36.558242 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:36.558205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:36.558705 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:36.558587    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:36.559530 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:36.559513    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:13:47.087531 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.087494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:47.110442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.110408    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"]
Jul 28 13:13:47.110690 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.110662    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx" podUID="e2db2848-763a-449f-b119-ec1fd166cb9e" containerName="payload-processing" containerID="cri-o://3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e" gracePeriod=30
Jul 28 13:13:47.115123 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.115092    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"]
Jul 28 13:13:47.115651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.115576    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc" podUID="dd04ff43-12e7-413f-bf3b-b6ec4ba778e1" containerName="payload-pre-processing" containerID="cri-o://1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a" gracePeriod=30
Jul 28 13:13:47.158117 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.158085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:47.398814 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.398783    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:47.430882 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.430849    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:47.457910 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.457876    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-plugins-config-volume\") pod \"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1\" (UID: \"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1\") "
Jul 28 13:13:47.458162 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.457957    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpwm9\" (UniqueName: \"kubernetes.io/projected/e2db2848-763a-449f-b119-ec1fd166cb9e-kube-api-access-kpwm9\") pod \"e2db2848-763a-449f-b119-ec1fd166cb9e\" (UID: \"e2db2848-763a-449f-b119-ec1fd166cb9e\") "
Jul 28 13:13:47.458162 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.458078    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm5zr\" (UniqueName: \"kubernetes.io/projected/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-kube-api-access-mm5zr\") pod \"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1\" (UID: \"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1\") "
Jul 28 13:13:47.458162 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.458120    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2db2848-763a-449f-b119-ec1fd166cb9e-plugins-config-volume\") pod \"e2db2848-763a-449f-b119-ec1fd166cb9e\" (UID: \"e2db2848-763a-449f-b119-ec1fd166cb9e\") "
Jul 28 13:13:47.458379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.458357    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dd04ff43-12e7-413f-bf3b-b6ec4ba778e1" (UID: "dd04ff43-12e7-413f-bf3b-b6ec4ba778e1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:13:47.458592 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.458569    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2db2848-763a-449f-b119-ec1fd166cb9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e2db2848-763a-449f-b119-ec1fd166cb9e" (UID: "e2db2848-763a-449f-b119-ec1fd166cb9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:13:47.460560 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.460521    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-kube-api-access-mm5zr" (OuterVolumeSpecName: "kube-api-access-mm5zr") pod "dd04ff43-12e7-413f-bf3b-b6ec4ba778e1" (UID: "dd04ff43-12e7-413f-bf3b-b6ec4ba778e1"). InnerVolumeSpecName "kube-api-access-mm5zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:13:47.460744 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.460720    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2db2848-763a-449f-b119-ec1fd166cb9e-kube-api-access-kpwm9" (OuterVolumeSpecName: "kube-api-access-kpwm9") pod "e2db2848-763a-449f-b119-ec1fd166cb9e" (UID: "e2db2848-763a-449f-b119-ec1fd166cb9e"). InnerVolumeSpecName "kube-api-access-kpwm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:13:47.559649 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.559606    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e2db2848-763a-449f-b119-ec1fd166cb9e-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:47.559649 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.559639    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:47.559649 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.559650    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpwm9\" (UniqueName: \"kubernetes.io/projected/e2db2848-763a-449f-b119-ec1fd166cb9e-kube-api-access-kpwm9\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:47.559649 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:47.559659    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm5zr\" (UniqueName: \"kubernetes.io/projected/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1-kube-api-access-mm5zr\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:13:48.114130 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.114095    2565 generic.go:356] "Generic (PLEG): container finished" podID="e2db2848-763a-449f-b119-ec1fd166cb9e" containerID="3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e" exitCode=0
Jul 28 13:13:48.114596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.114144    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"
Jul 28 13:13:48.114596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.114189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx" event={"ID":"e2db2848-763a-449f-b119-ec1fd166cb9e","Type":"ContainerDied","Data":"3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e"}
Jul 28 13:13:48.114596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.114255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx" event={"ID":"e2db2848-763a-449f-b119-ec1fd166cb9e","Type":"ContainerDied","Data":"218990ac7c1e9335b2a35c03bbde146375b9c651832995d28b6f14325be6c5f4"}
Jul 28 13:13:48.114596 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.114281    2565 scope.go:117] "RemoveContainer" containerID="3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e"
Jul 28 13:13:48.115706 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.115663    2565 generic.go:356] "Generic (PLEG): container finished" podID="dd04ff43-12e7-413f-bf3b-b6ec4ba778e1" containerID="1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a" exitCode=0
Jul 28 13:13:48.116077 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.115718    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"
Jul 28 13:13:48.116077 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.115727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc" event={"ID":"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1","Type":"ContainerDied","Data":"1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a"}
Jul 28 13:13:48.116077 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.115767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc" event={"ID":"dd04ff43-12e7-413f-bf3b-b6ec4ba778e1","Type":"ContainerDied","Data":"383d54758ec927eaa6fd7ec90a33197186bf47c021286ff22b4338169641234a"}
Jul 28 13:13:48.124141 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.124121    2565 scope.go:117] "RemoveContainer" containerID="3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e"
Jul 28 13:13:48.124518 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:13:48.124494    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e\": container with ID starting with 3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e not found: ID does not exist" containerID="3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e"
Jul 28 13:13:48.124631 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.124524    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e"} err="failed to get container status \"3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e\": rpc error: code = NotFound desc = could not find container \"3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e\": container with ID starting with 3190dcc204ee29568386902a5caf242771deabbf786967fbee8323b91a29b28e not found: ID does not exist"
Jul 28 13:13:48.124631 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.124549    2565 scope.go:117] "RemoveContainer" containerID="1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a"
Jul 28 13:13:48.131839 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.131811    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"]
Jul 28 13:13:48.135635 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.135599    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-12b3e2-6df6d554b6-clmtx"]
Jul 28 13:13:48.137961 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.137943    2565 scope.go:117] "RemoveContainer" containerID="1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a"
Jul 28 13:13:48.138291 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:13:48.138271    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a\": container with ID starting with 1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a not found: ID does not exist" containerID="1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a"
Jul 28 13:13:48.138354 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.138301    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a"} err="failed to get container status \"1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a\": rpc error: code = NotFound desc = could not find container \"1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a\": container with ID starting with 1dca028326e75ffd6e83ff93cdd0b082e0a5a0f5c50df42ab72dbc70fc44577a not found: ID does not exist"
Jul 28 13:13:48.146346 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.146317    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"]
Jul 28 13:13:48.150130 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:48.150106    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-12b3e2-7d758888c6-26jsc"]
Jul 28 13:13:49.900313 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:49.900274    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd04ff43-12e7-413f-bf3b-b6ec4ba778e1" path="/var/lib/kubelet/pods/dd04ff43-12e7-413f-bf3b-b6ec4ba778e1/volumes"
Jul 28 13:13:49.900724 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:49.900639    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2db2848-763a-449f-b119-ec1fd166cb9e" path="/var/lib/kubelet/pods/e2db2848-763a-449f-b119-ec1fd166cb9e/volumes"
Jul 28 13:13:51.022276 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:51.022241    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:51.410113 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:51.410019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:57.463241 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:57.463188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:57.563387 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:57.563348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:57.705170 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:57.705127    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"]
Jul 28 13:13:57.705490 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:57.705461    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy" containerID="cri-o://23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161" gracePeriod=30
Jul 28 13:13:57.961869 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:57.961833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:13:58.062775 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:13:58.062742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:02.971716 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:02.971679    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:14:03.116369 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116270    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4n7z\" (UniqueName: \"kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-kube-api-access-x4n7z\") pod \"5a825db5-10f4-4288-9018-af25243a5059\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") "
Jul 28 13:14:03.116369 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116313    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-credential-socket\") pod \"5a825db5-10f4-4288-9018-af25243a5059\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") "
Jul 28 13:14:03.116369 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116333    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a825db5-10f4-4288-9018-af25243a5059-istio-podinfo\") pod \"5a825db5-10f4-4288-9018-af25243a5059\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") "
Jul 28 13:14:03.116369 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116351    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-envoy\") pod \"5a825db5-10f4-4288-9018-af25243a5059\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") "
Jul 28 13:14:03.116369 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-certs\") pod \"5a825db5-10f4-4288-9018-af25243a5059\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") "
Jul 28 13:14:03.116778 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116389    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-data\") pod \"5a825db5-10f4-4288-9018-af25243a5059\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") "
Jul 28 13:14:03.116778 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116435    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-istio-token\") pod \"5a825db5-10f4-4288-9018-af25243a5059\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") "
Jul 28 13:14:03.116778 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116468    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a825db5-10f4-4288-9018-af25243a5059-istiod-ca-cert\") pod \"5a825db5-10f4-4288-9018-af25243a5059\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") "
Jul 28 13:14:03.116778 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116632    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a825db5-10f4-4288-9018-af25243a5059" (UID: "5a825db5-10f4-4288-9018-af25243a5059"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:14:03.116778 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116669    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a825db5-10f4-4288-9018-af25243a5059" (UID: "5a825db5-10f4-4288-9018-af25243a5059"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:14:03.116778 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116695    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-socket\") pod \"5a825db5-10f4-4288-9018-af25243a5059\" (UID: \"5a825db5-10f4-4288-9018-af25243a5059\") "
Jul 28 13:14:03.117102 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116899    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a825db5-10f4-4288-9018-af25243a5059-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a825db5-10f4-4288-9018-af25243a5059" (UID: "5a825db5-10f4-4288-9018-af25243a5059"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:14:03.117102 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.116918    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a825db5-10f4-4288-9018-af25243a5059" (UID: "5a825db5-10f4-4288-9018-af25243a5059"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:14:03.117211 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.117125    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a825db5-10f4-4288-9018-af25243a5059-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:03.117211 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.117146    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:03.117211 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.117163    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:03.117211 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.117177    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:03.117812 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.117781    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a825db5-10f4-4288-9018-af25243a5059" (UID: "5a825db5-10f4-4288-9018-af25243a5059"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:14:03.118850 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.118826    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a825db5-10f4-4288-9018-af25243a5059" (UID: "5a825db5-10f4-4288-9018-af25243a5059"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:14:03.119020 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.119003    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-kube-api-access-x4n7z" (OuterVolumeSpecName: "kube-api-access-x4n7z") pod "5a825db5-10f4-4288-9018-af25243a5059" (UID: "5a825db5-10f4-4288-9018-af25243a5059"). InnerVolumeSpecName "kube-api-access-x4n7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:14:03.119294 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.119277    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a825db5-10f4-4288-9018-af25243a5059-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a825db5-10f4-4288-9018-af25243a5059" (UID: "5a825db5-10f4-4288-9018-af25243a5059"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:14:03.119351 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.119291    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a825db5-10f4-4288-9018-af25243a5059" (UID: "5a825db5-10f4-4288-9018-af25243a5059"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:14:03.198899 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.198862    2565 generic.go:356] "Generic (PLEG): container finished" podID="5a825db5-10f4-4288-9018-af25243a5059" containerID="23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161" exitCode=0
Jul 28 13:14:03.199147 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.198921    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"
Jul 28 13:14:03.199147 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.198920    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" event={"ID":"5a825db5-10f4-4288-9018-af25243a5059","Type":"ContainerDied","Data":"23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161"}
Jul 28 13:14:03.199147 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.199053    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg" event={"ID":"5a825db5-10f4-4288-9018-af25243a5059","Type":"ContainerDied","Data":"ba2abb326a0830dec99920015e8a1001b78be16587ffcdf83a0d8d507f8d5ee9"}
Jul 28 13:14:03.199147 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.199084    2565 scope.go:117] "RemoveContainer" containerID="23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161"
Jul 28 13:14:03.209162 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.209142    2565 scope.go:117] "RemoveContainer" containerID="9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691"
Jul 28 13:14:03.217888 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.217853    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:03.217888 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.217884    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:03.217888 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.217896    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4n7z\" (UniqueName: \"kubernetes.io/projected/5a825db5-10f4-4288-9018-af25243a5059-kube-api-access-x4n7z\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:03.218210 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.217906    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a825db5-10f4-4288-9018-af25243a5059-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:03.218210 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.217915    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a825db5-10f4-4288-9018-af25243a5059-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:03.219134 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.219109    2565 scope.go:117] "RemoveContainer" containerID="23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161"
Jul 28 13:14:03.219456 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:14:03.219438    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161\": container with ID starting with 23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161 not found: ID does not exist" containerID="23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161"
Jul 28 13:14:03.219512 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.219466    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161"} err="failed to get container status \"23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161\": rpc error: code = NotFound desc = could not find container \"23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161\": container with ID starting with 23ab0b78b66beca47a58ec2546b829bacedb4f5145c485e5200e41b51c9f1161 not found: ID does not exist"
Jul 28 13:14:03.219512 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.219485    2565 scope.go:117] "RemoveContainer" containerID="9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691"
Jul 28 13:14:03.219758 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.219736    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"]
Jul 28 13:14:03.219814 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:14:03.219741    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691\": container with ID starting with 9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691 not found: ID does not exist" containerID="9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691"
Jul 28 13:14:03.219814 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.219796    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691"} err="failed to get container status \"9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691\": rpc error: code = NotFound desc = could not find container \"9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691\": container with ID starting with 9343ea88ad4f31a26388691ddf4280322c42a9fd66c0e326f2f41abbd5288691 not found: ID does not exist"
Jul 28 13:14:03.225258 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.225228    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-12b3e2-openshift-default-c56b4b694-jx2zg"]
Jul 28 13:14:03.900146 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:03.900113    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a825db5-10f4-4288-9018-af25243a5059" path="/var/lib/kubelet/pods/5a825db5-10f4-4288-9018-af25243a5059/volumes"
Jul 28 13:14:13.771784 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:13.771740    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"]
Jul 28 13:14:13.772321 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:13.772046    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv" podUID="40c006cc-a04f-48d5-b1ef-dd50f92cb842" containerName="payload-pre-processing" containerID="cri-o://9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd" gracePeriod=30
Jul 28 13:14:14.036401 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.036322    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:14:14.127716 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.127673    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8dvr\" (UniqueName: \"kubernetes.io/projected/40c006cc-a04f-48d5-b1ef-dd50f92cb842-kube-api-access-k8dvr\") pod \"40c006cc-a04f-48d5-b1ef-dd50f92cb842\" (UID: \"40c006cc-a04f-48d5-b1ef-dd50f92cb842\") "
Jul 28 13:14:14.127906 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.127737    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40c006cc-a04f-48d5-b1ef-dd50f92cb842-plugins-config-volume\") pod \"40c006cc-a04f-48d5-b1ef-dd50f92cb842\" (UID: \"40c006cc-a04f-48d5-b1ef-dd50f92cb842\") "
Jul 28 13:14:14.128204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.128179    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40c006cc-a04f-48d5-b1ef-dd50f92cb842-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40c006cc-a04f-48d5-b1ef-dd50f92cb842" (UID: "40c006cc-a04f-48d5-b1ef-dd50f92cb842"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:14:14.130113 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.130074    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40c006cc-a04f-48d5-b1ef-dd50f92cb842-kube-api-access-k8dvr" (OuterVolumeSpecName: "kube-api-access-k8dvr") pod "40c006cc-a04f-48d5-b1ef-dd50f92cb842" (UID: "40c006cc-a04f-48d5-b1ef-dd50f92cb842"). InnerVolumeSpecName "kube-api-access-k8dvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:14:14.228428 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.228391    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8dvr\" (UniqueName: \"kubernetes.io/projected/40c006cc-a04f-48d5-b1ef-dd50f92cb842-kube-api-access-k8dvr\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:14.228428 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.228425    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40c006cc-a04f-48d5-b1ef-dd50f92cb842-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:14.260966 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.260932    2565 generic.go:356] "Generic (PLEG): container finished" podID="40c006cc-a04f-48d5-b1ef-dd50f92cb842" containerID="9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd" exitCode=0
Jul 28 13:14:14.261189 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.261018    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"
Jul 28 13:14:14.261189 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.261021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv" event={"ID":"40c006cc-a04f-48d5-b1ef-dd50f92cb842","Type":"ContainerDied","Data":"9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd"}
Jul 28 13:14:14.261189 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.261084    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv" event={"ID":"40c006cc-a04f-48d5-b1ef-dd50f92cb842","Type":"ContainerDied","Data":"7ea2efc7290e76fb1ea25ae9d0c787db7c2979241987f930633ab8aced48d7d9"}
Jul 28 13:14:14.261189 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.261109    2565 scope.go:117] "RemoveContainer" containerID="9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd"
Jul 28 13:14:14.271673 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.271645    2565 scope.go:117] "RemoveContainer" containerID="9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd"
Jul 28 13:14:14.272030 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:14:14.272007    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd\": container with ID starting with 9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd not found: ID does not exist" containerID="9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd"
Jul 28 13:14:14.272132 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.272039    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd"} err="failed to get container status \"9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd\": rpc error: code = NotFound desc = could not find container \"9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd\": container with ID starting with 9305f5e5a8f36a7becf1fb35406109823b6fff1bacefd3dfc487a900e00f26fd not found: ID does not exist"
Jul 28 13:14:14.281517 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.281480    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"]
Jul 28 13:14:14.285515 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.285475    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-bec5cf-657c465ddd-kmtjv"]
Jul 28 13:14:14.590029 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.589904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:14.738798 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:14.738761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:15.900024 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:15.899968    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40c006cc-a04f-48d5-b1ef-dd50f92cb842" path="/var/lib/kubelet/pods/40c006cc-a04f-48d5-b1ef-dd50f92cb842/volumes"
Jul 28 13:14:16.072170 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:16.072134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:18.154670 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:18.154637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:18.528992 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:18.528939    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:24.263005 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:24.262915    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:24.364918 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:24.364875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:24.582179 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:24.582079    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"]
Jul 28 13:14:24.582392 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:24.582349    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy" containerID="cri-o://02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a" gracePeriod=30
Jul 28 13:14:24.605628 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:24.605590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:24.865686 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:24.865569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:25.259673 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.259640    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:25.581038 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.580921    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"]
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581336    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581352    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581362    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581368    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581377    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40c006cc-a04f-48d5-b1ef-dd50f92cb842" containerName="payload-pre-processing"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581382    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c006cc-a04f-48d5-b1ef-dd50f92cb842" containerName="payload-pre-processing"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581399    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd04ff43-12e7-413f-bf3b-b6ec4ba778e1" containerName="payload-pre-processing"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581416    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd04ff43-12e7-413f-bf3b-b6ec4ba778e1" containerName="payload-pre-processing"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581429    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2db2848-763a-449f-b119-ec1fd166cb9e" containerName="payload-processing"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581435    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2db2848-763a-449f-b119-ec1fd166cb9e" containerName="payload-processing"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581491    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581503    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd04ff43-12e7-413f-bf3b-b6ec4ba778e1" containerName="payload-pre-processing"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581512    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="40c006cc-a04f-48d5-b1ef-dd50f92cb842" containerName="payload-pre-processing"
Jul 28 13:14:25.581518 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.581519    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2db2848-763a-449f-b119-ec1fd166cb9e" containerName="payload-processing"
Jul 28 13:14:25.586228 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.586194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.588428 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.588400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-67d68f-openshift-default-dockercfg-gwmpt\""
Jul 28 13:14:25.597686 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.597650    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"]
Jul 28 13:14:25.613826 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.613769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:25.622797 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.622751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-data\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.622797 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.622797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-socket\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.623111 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.622831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfrgh\" (UniqueName: \"kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-kube-api-access-vfrgh\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.623111 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.622862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-podinfo\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.623111 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.622925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-token\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.623111 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.623047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-credential-socket\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.623111 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.623102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-certs\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.623340 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.623161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istiod-ca-cert\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.623340 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.623188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-envoy\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.723783 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.723735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-token\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724059 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.723822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-credential-socket\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724059 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.723874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-certs\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724059 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.723924    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istiod-ca-cert\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724059 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.723956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-envoy\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724059 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.724020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-data\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724059 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.724047    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-socket\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724402 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.724080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfrgh\" (UniqueName: \"kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-kube-api-access-vfrgh\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724402 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.724114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-podinfo\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724402 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.724336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-certs\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.724403    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-data\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724650 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.724578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-socket\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724650 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.724604    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-credential-socket\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.724942 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.724891    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istiod-ca-cert\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.726939 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.726913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-envoy\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.727151 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.727131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-podinfo\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.735327 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.735294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-token\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.735486 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.735327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfrgh\" (UniqueName: \"kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-kube-api-access-vfrgh\") pod \"e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") " pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:25.758926 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.758886    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:25.899264 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:25.899167    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:26.060458 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:26.060428    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"]
Jul 28 13:14:26.062776 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:14:26.062739    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9cab7c_fdf5_407d_bcfd_241fe7513a91.slice/crio-d65878d201a5ba8220bfdd073f8f14acc02ed24a350dd04e423b9b9b15a82908 WatchSource:0}: Error finding container d65878d201a5ba8220bfdd073f8f14acc02ed24a350dd04e423b9b9b15a82908: Status 404 returned error can't find the container with id d65878d201a5ba8220bfdd073f8f14acc02ed24a350dd04e423b9b9b15a82908
Jul 28 13:14:26.065314 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:26.065274    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:26.065426 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:26.065370    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:26.065474 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:26.065426    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:26.332934 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:26.332897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" event={"ID":"1e9cab7c-fdf5-407d-bcfd-241fe7513a91","Type":"ContainerStarted","Data":"e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f"}
Jul 28 13:14:26.333140 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:26.332963    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" event={"ID":"1e9cab7c-fdf5-407d-bcfd-241fe7513a91","Type":"ContainerStarted","Data":"d65878d201a5ba8220bfdd073f8f14acc02ed24a350dd04e423b9b9b15a82908"}
Jul 28 13:14:26.367486 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:26.367372    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" podStartSLOduration=1.367345874 podStartE2EDuration="1.367345874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:14:26.364673308 +0000 UTC m=+2674.974539015" watchObservedRunningTime="2026-07-28 13:14:26.367345874 +0000 UTC m=+2674.977211586"
Jul 28 13:14:26.900189 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:26.900145    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:27.905163 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:27.905131    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:28.344886 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:28.344848    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:28.346024 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:28.345992    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:28.471377 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:28.471334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:28.587197 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:28.587165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:28.681477 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:28.681373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:28.781047 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:28.781013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:29.232304 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.232269    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:29.349903 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.349860    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"]
Jul 28 13:14:29.350369 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.350355    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a825db5-10f4-4288-9018-af25243a5059" containerName="istio-proxy"
Jul 28 13:14:29.353373 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.353351    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:14:29.355609 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.355578    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-67d68f-dockercfg-cvs5s\""
Jul 28 13:14:29.355770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.355578    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-67d68f\""
Jul 28 13:14:29.369442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.369392    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"]
Jul 28 13:14:29.378012 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.376703    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"]
Jul 28 13:14:29.382285 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.382248    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:14:29.388638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.388606    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"]
Jul 28 13:14:29.407438 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.407396    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:29.457189 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.457151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d68e03e1-dba2-429d-822a-08bc56640805-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr\" (UID: \"d68e03e1-dba2-429d-822a-08bc56640805\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:14:29.457442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.457285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6glpg\" (UniqueName: \"kubernetes.io/projected/d68e03e1-dba2-429d-822a-08bc56640805-kube-api-access-6glpg\") pod \"payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr\" (UID: \"d68e03e1-dba2-429d-822a-08bc56640805\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:14:29.457442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.457361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af0256d6-7825-4c81-b78f-1c3f9e374e88-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n\" (UID: \"af0256d6-7825-4c81-b78f-1c3f9e374e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:14:29.457578 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.457430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj6f4\" (UniqueName: \"kubernetes.io/projected/af0256d6-7825-4c81-b78f-1c3f9e374e88-kube-api-access-bj6f4\") pod \"payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n\" (UID: \"af0256d6-7825-4c81-b78f-1c3f9e374e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:14:29.558427 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.558319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6glpg\" (UniqueName: \"kubernetes.io/projected/d68e03e1-dba2-429d-822a-08bc56640805-kube-api-access-6glpg\") pod \"payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr\" (UID: \"d68e03e1-dba2-429d-822a-08bc56640805\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:14:29.558427 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.558403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af0256d6-7825-4c81-b78f-1c3f9e374e88-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n\" (UID: \"af0256d6-7825-4c81-b78f-1c3f9e374e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:14:29.558721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.558440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj6f4\" (UniqueName: \"kubernetes.io/projected/af0256d6-7825-4c81-b78f-1c3f9e374e88-kube-api-access-bj6f4\") pod \"payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n\" (UID: \"af0256d6-7825-4c81-b78f-1c3f9e374e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:14:29.558721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.558489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d68e03e1-dba2-429d-822a-08bc56640805-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr\" (UID: \"d68e03e1-dba2-429d-822a-08bc56640805\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:14:29.559210 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.559188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af0256d6-7825-4c81-b78f-1c3f9e374e88-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n\" (UID: \"af0256d6-7825-4c81-b78f-1c3f9e374e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:14:29.559258 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.559192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d68e03e1-dba2-429d-822a-08bc56640805-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr\" (UID: \"d68e03e1-dba2-429d-822a-08bc56640805\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:14:29.569656 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.569613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6glpg\" (UniqueName: \"kubernetes.io/projected/d68e03e1-dba2-429d-822a-08bc56640805-kube-api-access-6glpg\") pod \"payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr\" (UID: \"d68e03e1-dba2-429d-822a-08bc56640805\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:14:29.569822 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.569715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj6f4\" (UniqueName: \"kubernetes.io/projected/af0256d6-7825-4c81-b78f-1c3f9e374e88-kube-api-access-bj6f4\") pod \"payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n\" (UID: \"af0256d6-7825-4c81-b78f-1c3f9e374e88\") " pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:14:29.665281 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.665244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:14:29.695873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.695818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:14:29.886375 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.886341    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:14:29.887636 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.887613    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"]
Jul 28 13:14:29.890013 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:14:29.889958    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0256d6_7825_4c81_b78f_1c3f9e374e88.slice/crio-f09656da4873d2ff657afd483a7ff50ee1afd8ca1583addd238ad3b8bc3b583d WatchSource:0}: Error finding container f09656da4873d2ff657afd483a7ff50ee1afd8ca1583addd238ad3b8bc3b583d: Status 404 returned error can't find the container with id f09656da4873d2ff657afd483a7ff50ee1afd8ca1583addd238ad3b8bc3b583d
Jul 28 13:14:29.961827 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.961799    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-token\") pod \"cfbbf371-f71d-4025-8b84-2285c047d9a9\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") "
Jul 28 13:14:29.962031 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.961864    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-data\") pod \"cfbbf371-f71d-4025-8b84-2285c047d9a9\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") "
Jul 28 13:14:29.962186 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.962163    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-envoy\") pod \"cfbbf371-f71d-4025-8b84-2285c047d9a9\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") "
Jul 28 13:14:29.962252 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.962211    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-podinfo\") pod \"cfbbf371-f71d-4025-8b84-2285c047d9a9\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") "
Jul 28 13:14:29.962305 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.962250    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfbbf371-f71d-4025-8b84-2285c047d9a9-istiod-ca-cert\") pod \"cfbbf371-f71d-4025-8b84-2285c047d9a9\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") "
Jul 28 13:14:29.962365 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.962349    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-credential-socket\") pod \"cfbbf371-f71d-4025-8b84-2285c047d9a9\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") "
Jul 28 13:14:29.962424 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.962379    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-socket\") pod \"cfbbf371-f71d-4025-8b84-2285c047d9a9\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") "
Jul 28 13:14:29.962480 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.962458    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blvvd\" (UniqueName: \"kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-kube-api-access-blvvd\") pod \"cfbbf371-f71d-4025-8b84-2285c047d9a9\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") "
Jul 28 13:14:29.962533 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.962487    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-certs\") pod \"cfbbf371-f71d-4025-8b84-2285c047d9a9\" (UID: \"cfbbf371-f71d-4025-8b84-2285c047d9a9\") "
Jul 28 13:14:29.963051 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.963015    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "cfbbf371-f71d-4025-8b84-2285c047d9a9" (UID: "cfbbf371-f71d-4025-8b84-2285c047d9a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:14:29.963523 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.963418    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cfbbf371-f71d-4025-8b84-2285c047d9a9" (UID: "cfbbf371-f71d-4025-8b84-2285c047d9a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:14:29.963523 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.963464    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfbbf371-f71d-4025-8b84-2285c047d9a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cfbbf371-f71d-4025-8b84-2285c047d9a9" (UID: "cfbbf371-f71d-4025-8b84-2285c047d9a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:14:29.963523 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.963480    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cfbbf371-f71d-4025-8b84-2285c047d9a9" (UID: "cfbbf371-f71d-4025-8b84-2285c047d9a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:14:29.963523 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.963496    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cfbbf371-f71d-4025-8b84-2285c047d9a9" (UID: "cfbbf371-f71d-4025-8b84-2285c047d9a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:14:29.964589 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.964560    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "cfbbf371-f71d-4025-8b84-2285c047d9a9" (UID: "cfbbf371-f71d-4025-8b84-2285c047d9a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:14:29.964829 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.964781    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cfbbf371-f71d-4025-8b84-2285c047d9a9" (UID: "cfbbf371-f71d-4025-8b84-2285c047d9a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:14:29.965656 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.965629    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cfbbf371-f71d-4025-8b84-2285c047d9a9" (UID: "cfbbf371-f71d-4025-8b84-2285c047d9a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:14:29.966147 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:29.966121    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-kube-api-access-blvvd" (OuterVolumeSpecName: "kube-api-access-blvvd") pod "cfbbf371-f71d-4025-8b84-2285c047d9a9" (UID: "cfbbf371-f71d-4025-8b84-2285c047d9a9"). InnerVolumeSpecName "kube-api-access-blvvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:14:30.048482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.048390    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"]
Jul 28 13:14:30.050947 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:14:30.050905    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68e03e1_dba2_429d_822a_08bc56640805.slice/crio-5e7789b33130b6b081e5b888bcd5c7c5341946fdf3eaf7e4534c7c851107b301 WatchSource:0}: Error finding container 5e7789b33130b6b081e5b888bcd5c7c5341946fdf3eaf7e4534c7c851107b301: Status 404 returned error can't find the container with id 5e7789b33130b6b081e5b888bcd5c7c5341946fdf3eaf7e4534c7c851107b301
Jul 28 13:14:30.063725 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.063691    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:30.063725 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.063722    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:30.063892 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.063735    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blvvd\" (UniqueName: \"kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-kube-api-access-blvvd\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:30.063892 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.063745    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:30.063892 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.063755    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:30.063892 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.063763    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:30.063892 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.063770    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:30.063892 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.063780    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfbbf371-f71d-4025-8b84-2285c047d9a9-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:30.063892 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.063787    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfbbf371-f71d-4025-8b84-2285c047d9a9-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:14:30.356375 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.356265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr" event={"ID":"d68e03e1-dba2-429d-822a-08bc56640805","Type":"ContainerStarted","Data":"ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066"}
Jul 28 13:14:30.356854 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.356442    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:14:30.356854 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.356497    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr" event={"ID":"d68e03e1-dba2-429d-822a-08bc56640805","Type":"ContainerStarted","Data":"5e7789b33130b6b081e5b888bcd5c7c5341946fdf3eaf7e4534c7c851107b301"}
Jul 28 13:14:30.358038 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.358010    2565 generic.go:356] "Generic (PLEG): container finished" podID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerID="02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a" exitCode=0
Jul 28 13:14:30.358164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.358096    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" event={"ID":"cfbbf371-f71d-4025-8b84-2285c047d9a9","Type":"ContainerDied","Data":"02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a"}
Jul 28 13:14:30.358164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.358113    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"
Jul 28 13:14:30.358164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.358153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf" event={"ID":"cfbbf371-f71d-4025-8b84-2285c047d9a9","Type":"ContainerDied","Data":"94336f0573517ef288b7a11b2eea4fdaac41d5e3b88f2025228e8b7ff371a720"}
Jul 28 13:14:30.358329 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.358184    2565 scope.go:117] "RemoveContainer" containerID="02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a"
Jul 28 13:14:30.359929 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.359903    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n" event={"ID":"af0256d6-7825-4c81-b78f-1c3f9e374e88","Type":"ContainerStarted","Data":"b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273"}
Jul 28 13:14:30.360073 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.359958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n" event={"ID":"af0256d6-7825-4c81-b78f-1c3f9e374e88","Type":"ContainerStarted","Data":"f09656da4873d2ff657afd483a7ff50ee1afd8ca1583addd238ad3b8bc3b583d"}
Jul 28 13:14:30.360154 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.360139    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:14:30.368212 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.368189    2565 scope.go:117] "RemoveContainer" containerID="3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe"
Jul 28 13:14:30.372033 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.371852    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr" podStartSLOduration=1.371832057 podStartE2EDuration="1.371832057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:14:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:14:30.371570215 +0000 UTC m=+2678.981435924" watchObservedRunningTime="2026-07-28 13:14:30.371832057 +0000 UTC m=+2678.981697767"
Jul 28 13:14:30.378913 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.378887    2565 scope.go:117] "RemoveContainer" containerID="02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a"
Jul 28 13:14:30.379373 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:14:30.379335    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a\": container with ID starting with 02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a not found: ID does not exist" containerID="02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a"
Jul 28 13:14:30.379482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.379381    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a"} err="failed to get container status \"02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a\": rpc error: code = NotFound desc = could not find container \"02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a\": container with ID starting with 02ada1bb53954259330f7b0d3a91c041a237c064a58012cb144b52e2bf59385a not found: ID does not exist"
Jul 28 13:14:30.379482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.379407    2565 scope.go:117] "RemoveContainer" containerID="3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe"
Jul 28 13:14:30.379941 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:14:30.379914    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe\": container with ID starting with 3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe not found: ID does not exist" containerID="3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe"
Jul 28 13:14:30.380057 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.379952    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe"} err="failed to get container status \"3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe\": rpc error: code = NotFound desc = could not find container \"3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe\": container with ID starting with 3ed77872b0883be3b1afb4d489a875fde6f57f89afce056e194bada7fd3304fe not found: ID does not exist"
Jul 28 13:14:30.390123 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.390062    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n" podStartSLOduration=1.390040895 podStartE2EDuration="1.390040895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:14:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:14:30.387367707 +0000 UTC m=+2678.997233415" watchObservedRunningTime="2026-07-28 13:14:30.390040895 +0000 UTC m=+2678.999906603"
Jul 28 13:14:30.402212 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.402170    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"]
Jul 28 13:14:30.409627 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:30.409591    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-bec5cf-openshift-default-84dd84466b-8jdjf"]
Jul 28 13:14:31.903789 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:31.903749    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" path="/var/lib/kubelet/pods/cfbbf371-f71d-4025-8b84-2285c047d9a9/volumes"
Jul 28 13:14:32.953165 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:32.953123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:33.319125 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.319025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:33.660875 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.660778    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"]
Jul 28 13:14:33.661310 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.661293    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy"
Jul 28 13:14:33.661379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.661312    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy"
Jul 28 13:14:33.661379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.661327    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy"
Jul 28 13:14:33.661379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.661333    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy"
Jul 28 13:14:33.661547 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.661400    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy"
Jul 28 13:14:33.661547 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.661423    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfbbf371-f71d-4025-8b84-2285c047d9a9" containerName="istio-proxy"
Jul 28 13:14:33.666659 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.666630    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.669097 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.669054    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-827464-openshift-default-dockercfg-g9bhq\""
Jul 28 13:14:33.689944 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.689906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"]
Jul 28 13:14:33.696142 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.694064    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:33.703191 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.703153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-envoy\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.703191 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.703577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2v9w\" (UniqueName: \"kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-kube-api-access-h2v9w\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.703191 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.703647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d99b0ee0-6774-40ab-ba82-606e14aa8138-istiod-ca-cert\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.703191 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.703684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-socket\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.703191 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.703762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-podinfo\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.703191 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.703838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-token\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.703191 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.703866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-credential-socket\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.704425 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.704046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-certs\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.704425 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.704109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-data\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.805341 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.805300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-envoy\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.805964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.805359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2v9w\" (UniqueName: \"kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-kube-api-access-h2v9w\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.805964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.805420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d99b0ee0-6774-40ab-ba82-606e14aa8138-istiod-ca-cert\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.805964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.805452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-socket\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.805964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.805518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-podinfo\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.805964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.805554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-token\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.805964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.805583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-credential-socket\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.805964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.805622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-certs\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.805964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.805669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-data\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.806497 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.806085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-credential-socket\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.806497 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.806332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-certs\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.806497 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.806445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d99b0ee0-6774-40ab-ba82-606e14aa8138-istiod-ca-cert\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.806644 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.806559    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-data\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.806644 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.806593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-socket\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.808533 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.808513    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-envoy\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.808859 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.808840    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-podinfo\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.813440 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.813390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-token\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.813580 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.813517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2v9w\" (UniqueName: \"kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-kube-api-access-h2v9w\") pod \"e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") " pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:33.831679 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.831641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:33.981326 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:33.981282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:34.137845 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:34.137816    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"]
Jul 28 13:14:34.140015 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:14:34.139953    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99b0ee0_6774_40ab_ba82_606e14aa8138.slice/crio-4226f116cc29b97af5a9c36bc0b43891c74d5abb1a12833a278970635f741fc3 WatchSource:0}: Error finding container 4226f116cc29b97af5a9c36bc0b43891c74d5abb1a12833a278970635f741fc3: Status 404 returned error can't find the container with id 4226f116cc29b97af5a9c36bc0b43891c74d5abb1a12833a278970635f741fc3
Jul 28 13:14:34.142574 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:34.142536    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:34.142704 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:34.142610    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:34.142704 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:34.142648    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:34.386805 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:34.386688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" event={"ID":"d99b0ee0-6774-40ab-ba82-606e14aa8138","Type":"ContainerStarted","Data":"4734bd8de44e2969bf03bb48c2b0a04c889ade660506db36778543e513808d4a"}
Jul 28 13:14:34.386805 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:34.386762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" event={"ID":"d99b0ee0-6774-40ab-ba82-606e14aa8138","Type":"ContainerStarted","Data":"4226f116cc29b97af5a9c36bc0b43891c74d5abb1a12833a278970635f741fc3"}
Jul 28 13:14:34.406918 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:34.406842    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" podStartSLOduration=1.406819193 podStartE2EDuration="1.406819193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:14:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:14:34.406101411 +0000 UTC m=+2683.015967147" watchObservedRunningTime="2026-07-28 13:14:34.406819193 +0000 UTC m=+2683.016684906"
Jul 28 13:14:34.981887 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:34.981787    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:35.763993 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:35.763927    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:36.000411 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:36.000377    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:36.350533 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:36.350494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:36.406922 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:36.406887    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:36.408044 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:36.408021    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:36.436251 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:36.436220    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:36.509818 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:36.509747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:37.067075 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.067028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:37.165858 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.165822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:37.175438 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.175401    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"]
Jul 28 13:14:37.190364 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.190324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:14:37.193793 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.193756    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-827464\""
Jul 28 13:14:37.194233 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.194211    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-827464-dockercfg-rcf8r\""
Jul 28 13:14:37.195253 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.195221    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"]
Jul 28 13:14:37.238251 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.238210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:37.241361 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.241328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx8g9\" (UniqueName: \"kubernetes.io/projected/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-kube-api-access-rx8g9\") pod \"payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb\" (UID: \"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:14:37.241526 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.241479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb\" (UID: \"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:14:37.342442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.342339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb\" (UID: \"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:14:37.342442 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.342421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx8g9\" (UniqueName: \"kubernetes.io/projected/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-kube-api-access-rx8g9\") pod \"payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb\" (UID: \"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:14:37.343110 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.343090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb\" (UID: \"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:14:37.351850 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.351819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx8g9\" (UniqueName: \"kubernetes.io/projected/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-kube-api-access-rx8g9\") pod \"payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb\" (UID: \"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:14:37.518339 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.518299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:14:37.730575 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:37.730542    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"]
Jul 28 13:14:37.733149 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:14:37.733122    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba4f71b_8e12_46ef_9c96_c83e24a3bee7.slice/crio-833b4157ee500869b3365815daa29d57d204444cf19847ed8dc9e7fc986d2a70 WatchSource:0}: Error finding container 833b4157ee500869b3365815daa29d57d204444cf19847ed8dc9e7fc986d2a70: Status 404 returned error can't find the container with id 833b4157ee500869b3365815daa29d57d204444cf19847ed8dc9e7fc986d2a70
Jul 28 13:14:38.425705 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:38.425665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb" event={"ID":"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7","Type":"ContainerStarted","Data":"edf042747fb4da7dc185672e633a6892335d0a1447e3b0a9f6120499a84e97e6"}
Jul 28 13:14:38.426182 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:38.425743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:14:38.426182 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:38.425775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb" event={"ID":"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7","Type":"ContainerStarted","Data":"833b4157ee500869b3365815daa29d57d204444cf19847ed8dc9e7fc986d2a70"}
Jul 28 13:14:38.445314 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:38.444422    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb" podStartSLOduration=1.444393193 podStartE2EDuration="1.444393193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:14:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:14:38.440301532 +0000 UTC m=+2687.050167252" watchObservedRunningTime="2026-07-28 13:14:38.444393193 +0000 UTC m=+2687.054258902"
Jul 28 13:14:40.833645 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:40.833606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:41.368746 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:41.368712    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:14:41.368973 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:41.368816    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:14:42.451059 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:42.451016    2565 generic.go:356] "Generic (PLEG): container finished" podID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerID="e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f" exitCode=0
Jul 28 13:14:42.451577 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:42.451070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" event={"ID":"1e9cab7c-fdf5-407d-bcfd-241fe7513a91","Type":"ContainerDied","Data":"e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f"}
Jul 28 13:14:42.451577 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:42.451505    2565 scope.go:117] "RemoveContainer" containerID="e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f"
Jul 28 13:14:42.452676 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:42.452649    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:42.452745 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:42.452727    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:42.452790 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:42.452764    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:43.344795 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:43.344754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:43.462285 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:43.462241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" event={"ID":"1e9cab7c-fdf5-407d-bcfd-241fe7513a91","Type":"ContainerStarted","Data":"b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db"}
Jul 28 13:14:43.901594 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:43.901552    2565 patch_prober.go:28] interesting pod/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 13:14:43.901935 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:43.901899    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 13:14:43.904489 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:43.904448    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:44.900265 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:44.900225    2565 patch_prober.go:28] interesting pod/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 13:14:44.900875 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:44.900840    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 13:14:45.900342 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:45.900301    2565 patch_prober.go:28] interesting pod/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 13:14:45.900895 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:45.900418    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 13:14:45.905173 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:45.905130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:46.004283 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:46.004238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:46.900659 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:46.900618    2565 patch_prober.go:28] interesting pod/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 28 13:14:46.901312 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:46.901274    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 28 13:14:47.904626 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:47.904593    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:47.905157 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:47.905010    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:47.905778 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:47.905758    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:14:49.434068 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:49.434029    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:14:50.542993 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:50.542940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:51.408477 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:51.408380    2565 patch_prober.go:28] interesting pod/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 28 13:14:51.408477 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:51.408455    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 28 13:14:51.512816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:51.512782    2565 generic.go:356] "Generic (PLEG): container finished" podID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerID="4734bd8de44e2969bf03bb48c2b0a04c889ade660506db36778543e513808d4a" exitCode=0
Jul 28 13:14:51.513035 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:51.512838    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" event={"ID":"d99b0ee0-6774-40ab-ba82-606e14aa8138","Type":"ContainerDied","Data":"4734bd8de44e2969bf03bb48c2b0a04c889ade660506db36778543e513808d4a"}
Jul 28 13:14:51.513310 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:51.513295    2565 scope.go:117] "RemoveContainer" containerID="4734bd8de44e2969bf03bb48c2b0a04c889ade660506db36778543e513808d4a"
Jul 28 13:14:51.514527 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:51.514498    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:51.514595 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:51.514570    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:51.514632 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:51.514605    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:14:52.519801 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:52.519713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" event={"ID":"d99b0ee0-6774-40ab-ba82-606e14aa8138","Type":"ContainerStarted","Data":"95d10f48e0b4d8a4de8a95011fc99600a3532548065ab40e4a2ca501fd4aac23"}
Jul 28 13:14:52.982516 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:52.982424    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:52.982805 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:52.982772    2565 patch_prober.go:28] interesting pod/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 28 13:14:52.982965 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:52.982857    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 28 13:14:53.982138 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:53.982097    2565 patch_prober.go:28] interesting pod/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 28 13:14:53.982797 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:53.982759    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 28 13:14:54.982840 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:54.982795    2565 patch_prober.go:28] interesting pod/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 28 13:14:54.983538 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:54.983501    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 28 13:14:55.982562 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:55.982518    2565 patch_prober.go:28] interesting pod/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 28 13:14:55.982923 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:55.982889    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 28 13:14:56.982723 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:56.982669    2565 patch_prober.go:28] interesting pod/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Jul 28 13:14:56.982998 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:56.982746    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Jul 28 13:14:57.986699 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:57.986664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:57.987199 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:57.987015    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:14:57.987889 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:14:57.987874    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:15:01.623103 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:01.623066    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:15:01.626064 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:01.626037    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:15:11.217163 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.217121    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"]
Jul 28 13:15:11.222356 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.222326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.225304 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.225270    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-827464\"/\"openshift-service-ca.crt\""
Jul 28 13:15:11.225304 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.225307    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-827464\"/\"kube-root-ca.crt\""
Jul 28 13:15:11.225572 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.225335    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-827464\"/\"default-dockercfg-hgq5j\""
Jul 28 13:15:11.225572 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.225356    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-827464\"/\"auth-test-model-827464-kserve-self-signed-certs\""
Jul 28 13:15:11.229654 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.229619    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"]
Jul 28 13:15:11.263271 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.263207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:15:11.312187 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.312154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-tmp-dir\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.312382 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.312207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx2fv\" (UniqueName: \"kubernetes.io/projected/9652bf88-9cdf-4da7-a4a8-760b79b34729-kube-api-access-rx2fv\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.312382 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.312265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-dshm\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.312382 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.312287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-home\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.312382 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.312334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9652bf88-9cdf-4da7-a4a8-760b79b34729-tls-certs\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.312382 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.312360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-model-cache\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.413299 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.413259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9652bf88-9cdf-4da7-a4a8-760b79b34729-tls-certs\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.413540 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.413320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-model-cache\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.413540 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.413374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-tmp-dir\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.413540 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.413427    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx2fv\" (UniqueName: \"kubernetes.io/projected/9652bf88-9cdf-4da7-a4a8-760b79b34729-kube-api-access-rx2fv\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.413540 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.413475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-dshm\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.413540 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.413506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-home\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.413873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.413845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-tmp-dir\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.413956 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.413907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-home\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.414025 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.413972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-model-cache\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.415938 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.415905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-dshm\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.416256 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.416234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9652bf88-9cdf-4da7-a4a8-760b79b34729-tls-certs\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.422768 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.422741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx2fv\" (UniqueName: \"kubernetes.io/projected/9652bf88-9cdf-4da7-a4a8-760b79b34729-kube-api-access-rx2fv\") pod \"auth-test-model-827464-kserve-665bbbcc95-lnrzb\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") " pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.534290 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.534191    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:11.683071 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:11.683043    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"]
Jul 28 13:15:11.685375 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:15:11.685343    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9652bf88_9cdf_4da7_a4a8_760b79b34729.slice/crio-6f123aef759676c24e83c06d8adc198e4d14a4ba466136ee0ba39311ee82ef29 WatchSource:0}: Error finding container 6f123aef759676c24e83c06d8adc198e4d14a4ba466136ee0ba39311ee82ef29: Status 404 returned error can't find the container with id 6f123aef759676c24e83c06d8adc198e4d14a4ba466136ee0ba39311ee82ef29
Jul 28 13:15:12.632902 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:12.632865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb" event={"ID":"9652bf88-9cdf-4da7-a4a8-760b79b34729","Type":"ContainerStarted","Data":"8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50"}
Jul 28 13:15:12.633441 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:12.632911    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb" event={"ID":"9652bf88-9cdf-4da7-a4a8-760b79b34729","Type":"ContainerStarted","Data":"6f123aef759676c24e83c06d8adc198e4d14a4ba466136ee0ba39311ee82ef29"}
Jul 28 13:15:12.650650 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:12.650590    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb" podStartSLOduration=1.650568121 podStartE2EDuration="1.650568121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:15:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:15:12.648414847 +0000 UTC m=+2721.258280555" watchObservedRunningTime="2026-07-28 13:15:12.650568121 +0000 UTC m=+2721.260433869"
Jul 28 13:15:21.534720 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:21.534667    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:21.534720 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:21.534726    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:21.548131 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:21.548100    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:15:21.690612 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:15:21.690579    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:18:12.058737 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:18:12.058644    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:18:46.595292 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:18:46.595246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:39.447997 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:39.447936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:40.335546 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:40.335511    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"]
Jul 28 13:19:40.355717 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:40.355685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:55.356556 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.356496    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb" podUID="9652bf88-9cdf-4da7-a4a8-760b79b34729" containerName="main" containerID="cri-o://8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50" gracePeriod=45
Jul 28 13:19:55.619529 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.619456    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:19:55.697614 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.697582    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9652bf88-9cdf-4da7-a4a8-760b79b34729-tls-certs\") pod \"9652bf88-9cdf-4da7-a4a8-760b79b34729\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") "
Jul 28 13:19:55.697831 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.697631    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-model-cache\") pod \"9652bf88-9cdf-4da7-a4a8-760b79b34729\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") "
Jul 28 13:19:55.697831 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.697666    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx2fv\" (UniqueName: \"kubernetes.io/projected/9652bf88-9cdf-4da7-a4a8-760b79b34729-kube-api-access-rx2fv\") pod \"9652bf88-9cdf-4da7-a4a8-760b79b34729\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") "
Jul 28 13:19:55.697831 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.697690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-home\") pod \"9652bf88-9cdf-4da7-a4a8-760b79b34729\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") "
Jul 28 13:19:55.697831 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.697793    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-dshm\") pod \"9652bf88-9cdf-4da7-a4a8-760b79b34729\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") "
Jul 28 13:19:55.698190 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.697838    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-tmp-dir\") pod \"9652bf88-9cdf-4da7-a4a8-760b79b34729\" (UID: \"9652bf88-9cdf-4da7-a4a8-760b79b34729\") "
Jul 28 13:19:55.698190 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.697934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-model-cache" (OuterVolumeSpecName: "model-cache") pod "9652bf88-9cdf-4da7-a4a8-760b79b34729" (UID: "9652bf88-9cdf-4da7-a4a8-760b79b34729"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:19:55.698190 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.698068    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-home" (OuterVolumeSpecName: "home") pod "9652bf88-9cdf-4da7-a4a8-760b79b34729" (UID: "9652bf88-9cdf-4da7-a4a8-760b79b34729"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:19:55.698321 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.698198    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9652bf88-9cdf-4da7-a4a8-760b79b34729" (UID: "9652bf88-9cdf-4da7-a4a8-760b79b34729"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:19:55.698321 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.698290    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-model-cache\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:19:55.698321 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.698314    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-home\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:19:55.700052 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.700027    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9652bf88-9cdf-4da7-a4a8-760b79b34729-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9652bf88-9cdf-4da7-a4a8-760b79b34729" (UID: "9652bf88-9cdf-4da7-a4a8-760b79b34729"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:19:55.700148 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.700066    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-dshm" (OuterVolumeSpecName: "dshm") pod "9652bf88-9cdf-4da7-a4a8-760b79b34729" (UID: "9652bf88-9cdf-4da7-a4a8-760b79b34729"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:19:55.700148 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.700096    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9652bf88-9cdf-4da7-a4a8-760b79b34729-kube-api-access-rx2fv" (OuterVolumeSpecName: "kube-api-access-rx2fv") pod "9652bf88-9cdf-4da7-a4a8-760b79b34729" (UID: "9652bf88-9cdf-4da7-a4a8-760b79b34729"). InnerVolumeSpecName "kube-api-access-rx2fv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:19:55.799485 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.799433    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx2fv\" (UniqueName: \"kubernetes.io/projected/9652bf88-9cdf-4da7-a4a8-760b79b34729-kube-api-access-rx2fv\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:19:55.799485 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.799478    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-dshm\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:19:55.799485 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.799489    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9652bf88-9cdf-4da7-a4a8-760b79b34729-tmp-dir\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:19:55.799485 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:55.799498    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9652bf88-9cdf-4da7-a4a8-760b79b34729-tls-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:19:56.111770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:56.111722    2565 generic.go:356] "Generic (PLEG): container finished" podID="9652bf88-9cdf-4da7-a4a8-760b79b34729" containerID="8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50" exitCode=0
Jul 28 13:19:56.111770 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:56.111768    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb" event={"ID":"9652bf88-9cdf-4da7-a4a8-760b79b34729","Type":"ContainerDied","Data":"8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50"}
Jul 28 13:19:56.112061 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:56.111803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb" event={"ID":"9652bf88-9cdf-4da7-a4a8-760b79b34729","Type":"ContainerDied","Data":"6f123aef759676c24e83c06d8adc198e4d14a4ba466136ee0ba39311ee82ef29"}
Jul 28 13:19:56.112061 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:56.111822    2565 scope.go:117] "RemoveContainer" containerID="8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50"
Jul 28 13:19:56.112061 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:56.111769    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"
Jul 28 13:19:56.120889 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:56.120867    2565 scope.go:117] "RemoveContainer" containerID="8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50"
Jul 28 13:19:56.121239 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:19:56.121217    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50\": container with ID starting with 8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50 not found: ID does not exist" containerID="8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50"
Jul 28 13:19:56.121302 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:56.121249    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50"} err="failed to get container status \"8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50\": rpc error: code = NotFound desc = could not find container \"8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50\": container with ID starting with 8a2e7d364e6e369b222e3ad2135e8dc5cdced6e5019b3f34760baa68c047df50 not found: ID does not exist"
Jul 28 13:19:56.127101 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:56.127074    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"]
Jul 28 13:19:56.132911 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:56.132888    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-827464/auth-test-model-827464-kserve-665bbbcc95-lnrzb"]
Jul 28 13:19:57.900128 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:19:57.900086    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9652bf88-9cdf-4da7-a4a8-760b79b34729" path="/var/lib/kubelet/pods/9652bf88-9cdf-4da7-a4a8-760b79b34729/volumes"
Jul 28 13:20:01.656169 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:01.656134    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:20:01.660234 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:01.660207    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:20:04.335115 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.335077    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"]
Jul 28 13:20:04.335544 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.335473    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9652bf88-9cdf-4da7-a4a8-760b79b34729" containerName="main"
Jul 28 13:20:04.335544 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.335484    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9652bf88-9cdf-4da7-a4a8-760b79b34729" containerName="main"
Jul 28 13:20:04.335623 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.335553    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9652bf88-9cdf-4da7-a4a8-760b79b34729" containerName="main"
Jul 28 13:20:04.338581 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.338560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.341286 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.341254    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-67d68f\"/\"kube-root-ca.crt\""
Jul 28 13:20:04.341286 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.341254    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-67d68f\"/\"default-dockercfg-vc2fv\""
Jul 28 13:20:04.341532 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.341255    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-67d68f\"/\"openshift-service-ca.crt\""
Jul 28 13:20:04.341532 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.341262    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-67d68f\"/\"sub-test-model-67d68f-kserve-self-signed-certs\""
Jul 28 13:20:04.346386 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.346202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"]
Jul 28 13:20:04.443946 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.443912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:04.486883 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.486846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-dshm\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.486883 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.486893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-model-cache\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.487180 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.486925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msjtw\" (UniqueName: \"kubernetes.io/projected/518aaea6-c616-4bb6-980c-f60877e4d6c9-kube-api-access-msjtw\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.487180 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.486945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/518aaea6-c616-4bb6-980c-f60877e4d6c9-tls-certs\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.487180 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.487081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-home\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.487180 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.487127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-tmp-dir\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.588035 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.587916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-dshm\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.588035 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.587973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-model-cache\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.588265 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.588050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjtw\" (UniqueName: \"kubernetes.io/projected/518aaea6-c616-4bb6-980c-f60877e4d6c9-kube-api-access-msjtw\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.588265 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.588075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/518aaea6-c616-4bb6-980c-f60877e4d6c9-tls-certs\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.588265 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.588155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-home\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.588265 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.588191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-tmp-dir\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.588544 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.588522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-model-cache\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.588614 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.588563    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-tmp-dir\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.588614 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.588592    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-home\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.590482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.590455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-dshm\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.590792 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.590773    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/518aaea6-c616-4bb6-980c-f60877e4d6c9-tls-certs\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.597606 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.597576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msjtw\" (UniqueName: \"kubernetes.io/projected/518aaea6-c616-4bb6-980c-f60877e4d6c9-kube-api-access-msjtw\") pod \"sub-test-model-67d68f-kserve-54ddf5698f-7dpmb\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") " pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.650881 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.650825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:04.799613 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:04.799579    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"]
Jul 28 13:20:04.802453 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:20:04.802422    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod518aaea6_c616_4bb6_980c_f60877e4d6c9.slice/crio-0d063e430feaa6d1a759c59d688f0a98acd384fcad50f34abf8f47676c1663cb WatchSource:0}: Error finding container 0d063e430feaa6d1a759c59d688f0a98acd384fcad50f34abf8f47676c1663cb: Status 404 returned error can't find the container with id 0d063e430feaa6d1a759c59d688f0a98acd384fcad50f34abf8f47676c1663cb
Jul 28 13:20:05.173278 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:05.173155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb" event={"ID":"518aaea6-c616-4bb6-980c-f60877e4d6c9","Type":"ContainerStarted","Data":"d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52"}
Jul 28 13:20:05.173278 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:05.173220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb" event={"ID":"518aaea6-c616-4bb6-980c-f60877e4d6c9","Type":"ContainerStarted","Data":"0d063e430feaa6d1a759c59d688f0a98acd384fcad50f34abf8f47676c1663cb"}
Jul 28 13:20:05.190745 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:05.190678    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb" podStartSLOduration=1.190660459 podStartE2EDuration="1.190660459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:20:05.188391812 +0000 UTC m=+3013.798257520" watchObservedRunningTime="2026-07-28 13:20:05.190660459 +0000 UTC m=+3013.800526166"
Jul 28 13:20:14.651176 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:14.651132    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:14.651748 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:14.651417    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:14.663946 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:14.663921    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:15.233869 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:15.233838    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:20:28.519697 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:28.519663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:31.324087 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:31.324044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:43.721218 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:20:43.721137    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:04.117667 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:04.117625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:04.219232 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:04.219194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:28.092391 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:28.092350    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"]
Jul 28 13:21:28.117949 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:28.117912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:29.132364 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:29.132334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:34.813017 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.812930    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"]
Jul 28 13:21:34.816865 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.816837    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.819059 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.819033    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-67d68f\"/\"rate-test-model-67d68f-kserve-self-signed-certs\""
Jul 28 13:21:34.837579 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.837545    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"]
Jul 28 13:21:34.891432 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.891384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-tmp-dir\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.891432 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.891430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-dshm\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.891669 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.891461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-model-cache\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.891669 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.891522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f166296f-e49b-4619-bf8b-3e855e901179-tls-certs\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.891669 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.891605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-home\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.891669 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.891636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvwfm\" (UniqueName: \"kubernetes.io/projected/f166296f-e49b-4619-bf8b-3e855e901179-kube-api-access-rvwfm\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.992378 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.992339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-dshm\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.992378 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.992386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-model-cache\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.992685 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.992427    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f166296f-e49b-4619-bf8b-3e855e901179-tls-certs\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.992685 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.992507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-home\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.992685 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.992578    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvwfm\" (UniqueName: \"kubernetes.io/projected/f166296f-e49b-4619-bf8b-3e855e901179-kube-api-access-rvwfm\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.992685 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.992666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-tmp-dir\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.992928 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.992826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-model-cache\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.993142 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.993121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-home\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.993207 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.993193    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-tmp-dir\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.995218 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.995193    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-dshm\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:34.995510 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:34.995486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f166296f-e49b-4619-bf8b-3e855e901179-tls-certs\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:35.000575 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:35.000541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvwfm\" (UniqueName: \"kubernetes.io/projected/f166296f-e49b-4619-bf8b-3e855e901179-kube-api-access-rvwfm\") pod \"rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") " pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:35.135578 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:35.135474    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:35.223270 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:35.223227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:35.298055 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:35.297798    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"]
Jul 28 13:21:35.300574 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:21:35.300539    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf166296f_e49b_4619_bf8b_3e855e901179.slice/crio-5ed2fdcd841ded1acb8edc8e302bf741762df14dd2a1cbebc78c396779fb838d WatchSource:0}: Error finding container 5ed2fdcd841ded1acb8edc8e302bf741762df14dd2a1cbebc78c396779fb838d: Status 404 returned error can't find the container with id 5ed2fdcd841ded1acb8edc8e302bf741762df14dd2a1cbebc78c396779fb838d
Jul 28 13:21:35.657666 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:35.657626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4" event={"ID":"f166296f-e49b-4619-bf8b-3e855e901179","Type":"ContainerStarted","Data":"d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432"}
Jul 28 13:21:35.657666 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:35.657670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4" event={"ID":"f166296f-e49b-4619-bf8b-3e855e901179","Type":"ContainerStarted","Data":"5ed2fdcd841ded1acb8edc8e302bf741762df14dd2a1cbebc78c396779fb838d"}
Jul 28 13:21:35.674852 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:35.674795    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4" podStartSLOduration=1.6747765079999999 podStartE2EDuration="1.674776508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:21:35.673388348 +0000 UTC m=+3104.283254055" watchObservedRunningTime="2026-07-28 13:21:35.674776508 +0000 UTC m=+3104.284642216"
Jul 28 13:21:43.113069 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.113017    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb" podUID="518aaea6-c616-4bb6-980c-f60877e4d6c9" containerName="main" containerID="cri-o://d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52" gracePeriod=45
Jul 28 13:21:43.381726 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.381692    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:21:43.475580 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.475538    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/518aaea6-c616-4bb6-980c-f60877e4d6c9-tls-certs\") pod \"518aaea6-c616-4bb6-980c-f60877e4d6c9\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") "
Jul 28 13:21:43.475580 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.475602    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-home\") pod \"518aaea6-c616-4bb6-980c-f60877e4d6c9\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") "
Jul 28 13:21:43.475827 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.475652    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-model-cache\") pod \"518aaea6-c616-4bb6-980c-f60877e4d6c9\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") "
Jul 28 13:21:43.475827 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.475690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-dshm\") pod \"518aaea6-c616-4bb6-980c-f60877e4d6c9\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") "
Jul 28 13:21:43.475827 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.475732    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-tmp-dir\") pod \"518aaea6-c616-4bb6-980c-f60877e4d6c9\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") "
Jul 28 13:21:43.475827 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.475786    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msjtw\" (UniqueName: \"kubernetes.io/projected/518aaea6-c616-4bb6-980c-f60877e4d6c9-kube-api-access-msjtw\") pod \"518aaea6-c616-4bb6-980c-f60877e4d6c9\" (UID: \"518aaea6-c616-4bb6-980c-f60877e4d6c9\") "
Jul 28 13:21:43.476090 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.475950    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-home" (OuterVolumeSpecName: "home") pod "518aaea6-c616-4bb6-980c-f60877e4d6c9" (UID: "518aaea6-c616-4bb6-980c-f60877e4d6c9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:21:43.476090 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.476058    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-model-cache" (OuterVolumeSpecName: "model-cache") pod "518aaea6-c616-4bb6-980c-f60877e4d6c9" (UID: "518aaea6-c616-4bb6-980c-f60877e4d6c9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:21:43.476204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.476104    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "518aaea6-c616-4bb6-980c-f60877e4d6c9" (UID: "518aaea6-c616-4bb6-980c-f60877e4d6c9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:21:43.476260 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.476212    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-tmp-dir\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:21:43.476260 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.476231    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-home\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:21:43.476260 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.476245    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-model-cache\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:21:43.478330 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.478298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-dshm" (OuterVolumeSpecName: "dshm") pod "518aaea6-c616-4bb6-980c-f60877e4d6c9" (UID: "518aaea6-c616-4bb6-980c-f60877e4d6c9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:21:43.478330 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.478305    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/518aaea6-c616-4bb6-980c-f60877e4d6c9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "518aaea6-c616-4bb6-980c-f60877e4d6c9" (UID: "518aaea6-c616-4bb6-980c-f60877e4d6c9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:21:43.478515 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.478327    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/518aaea6-c616-4bb6-980c-f60877e4d6c9-kube-api-access-msjtw" (OuterVolumeSpecName: "kube-api-access-msjtw") pod "518aaea6-c616-4bb6-980c-f60877e4d6c9" (UID: "518aaea6-c616-4bb6-980c-f60877e4d6c9"). InnerVolumeSpecName "kube-api-access-msjtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:21:43.577376 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.577330    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/518aaea6-c616-4bb6-980c-f60877e4d6c9-dshm\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:21:43.577376 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.577365    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msjtw\" (UniqueName: \"kubernetes.io/projected/518aaea6-c616-4bb6-980c-f60877e4d6c9-kube-api-access-msjtw\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:21:43.577376 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.577376    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/518aaea6-c616-4bb6-980c-f60877e4d6c9-tls-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:21:43.700737 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.700709    2565 generic.go:356] "Generic (PLEG): container finished" podID="518aaea6-c616-4bb6-980c-f60877e4d6c9" containerID="d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52" exitCode=0
Jul 28 13:21:43.700962 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.700759    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"
Jul 28 13:21:43.700962 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.700802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb" event={"ID":"518aaea6-c616-4bb6-980c-f60877e4d6c9","Type":"ContainerDied","Data":"d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52"}
Jul 28 13:21:43.700962 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.700849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb" event={"ID":"518aaea6-c616-4bb6-980c-f60877e4d6c9","Type":"ContainerDied","Data":"0d063e430feaa6d1a759c59d688f0a98acd384fcad50f34abf8f47676c1663cb"}
Jul 28 13:21:43.700962 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.700872    2565 scope.go:117] "RemoveContainer" containerID="d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52"
Jul 28 13:21:43.710912 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.710891    2565 scope.go:117] "RemoveContainer" containerID="d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52"
Jul 28 13:21:43.711282 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:21:43.711259    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52\": container with ID starting with d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52 not found: ID does not exist" containerID="d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52"
Jul 28 13:21:43.711362 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.711290    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52"} err="failed to get container status \"d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52\": rpc error: code = NotFound desc = could not find container \"d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52\": container with ID starting with d5b532f62459bcbfc6b2c278815d606b4f34a705e89de1d1da7332cb9f224f52 not found: ID does not exist"
Jul 28 13:21:43.722042 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.722000    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"]
Jul 28 13:21:43.723934 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.723909    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/sub-test-model-67d68f-kserve-54ddf5698f-7dpmb"]
Jul 28 13:21:43.901105 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:43.901067    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="518aaea6-c616-4bb6-980c-f60877e4d6c9" path="/var/lib/kubelet/pods/518aaea6-c616-4bb6-980c-f60877e4d6c9/volumes"
Jul 28 13:21:45.136083 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:45.136046    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:45.136536 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:45.136130    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:45.149403 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:45.149373    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:45.723952 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:45.723917    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:21:59.273319 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:21:59.273274    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:16.388725 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:16.388695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:17.781623 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:17.781587    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:31.763164 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:31.763121    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"]
Jul 28 13:23:31.788618 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:31.788579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:32.728443 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:32.728391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:33.719835 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:33.719798    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7487-140018767179312"]
Jul 28 13:23:33.720261 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:33.720234    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="518aaea6-c616-4bb6-980c-f60877e4d6c9" containerName="main"
Jul 28 13:23:33.720261 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:33.720247    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="518aaea6-c616-4bb6-980c-f60877e4d6c9" containerName="main"
Jul 28 13:23:33.720336 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:33.720302    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="518aaea6-c616-4bb6-980c-f60877e4d6c9" containerName="main"
Jul 28 13:23:33.723441 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:33.723425    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767179312"
Jul 28 13:23:33.726202 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:33.726180    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zcgkh\""
Jul 28 13:23:33.733340 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:33.733314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7487-140018767179312"]
Jul 28 13:23:33.775070 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:33.775032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nr4c\" (UniqueName: \"kubernetes.io/projected/32c6bfdb-62e8-4556-af6e-84f59ab39f29-kube-api-access-5nr4c\") pod \"test-curl-7487-140018767179312\" (UID: \"32c6bfdb-62e8-4556-af6e-84f59ab39f29\") " pod="opendatahub/test-curl-7487-140018767179312"
Jul 28 13:23:33.876203 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:33.876158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nr4c\" (UniqueName: \"kubernetes.io/projected/32c6bfdb-62e8-4556-af6e-84f59ab39f29-kube-api-access-5nr4c\") pod \"test-curl-7487-140018767179312\" (UID: \"32c6bfdb-62e8-4556-af6e-84f59ab39f29\") " pod="opendatahub/test-curl-7487-140018767179312"
Jul 28 13:23:33.886545 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:33.886512    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nr4c\" (UniqueName: \"kubernetes.io/projected/32c6bfdb-62e8-4556-af6e-84f59ab39f29-kube-api-access-5nr4c\") pod \"test-curl-7487-140018767179312\" (UID: \"32c6bfdb-62e8-4556-af6e-84f59ab39f29\") " pod="opendatahub/test-curl-7487-140018767179312"
Jul 28 13:23:34.034619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:34.034526    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767179312"
Jul 28 13:23:34.390293 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:34.390267    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7487-140018767179312"]
Jul 28 13:23:34.392697 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:23:34.392668    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32c6bfdb_62e8_4556_af6e_84f59ab39f29.slice/crio-6fb1ba1f6a568984c20d606110c3ed4ddad68b9ae6e87d76a1542bb2ccdd653e WatchSource:0}: Error finding container 6fb1ba1f6a568984c20d606110c3ed4ddad68b9ae6e87d76a1542bb2ccdd653e: Status 404 returned error can't find the container with id 6fb1ba1f6a568984c20d606110c3ed4ddad68b9ae6e87d76a1542bb2ccdd653e
Jul 28 13:23:34.394225 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:34.394202    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:23:35.276776 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:35.276745    2565 generic.go:356] "Generic (PLEG): container finished" podID="32c6bfdb-62e8-4556-af6e-84f59ab39f29" containerID="77c770410a7b884be5685159b7d180b5709b91452a2b23081efc700e548744ad" exitCode=0
Jul 28 13:23:35.277177 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:35.276826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7487-140018767179312" event={"ID":"32c6bfdb-62e8-4556-af6e-84f59ab39f29","Type":"ContainerDied","Data":"77c770410a7b884be5685159b7d180b5709b91452a2b23081efc700e548744ad"}
Jul 28 13:23:35.277177 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:35.276866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7487-140018767179312" event={"ID":"32c6bfdb-62e8-4556-af6e-84f59ab39f29","Type":"ContainerStarted","Data":"6fb1ba1f6a568984c20d606110c3ed4ddad68b9ae6e87d76a1542bb2ccdd653e"}
Jul 28 13:23:36.427907 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:36.427876    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767179312"
Jul 28 13:23:36.452598 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:36.452568    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7487-140018767179312_32c6bfdb-62e8-4556-af6e-84f59ab39f29/test-curl-7487-140018767179312/0.log"
Jul 28 13:23:36.481587 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:36.481529    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7487-140018767179312"]
Jul 28 13:23:36.489455 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:36.489422    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7487-140018767179312"]
Jul 28 13:23:36.506723 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:36.506689    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nr4c\" (UniqueName: \"kubernetes.io/projected/32c6bfdb-62e8-4556-af6e-84f59ab39f29-kube-api-access-5nr4c\") pod \"32c6bfdb-62e8-4556-af6e-84f59ab39f29\" (UID: \"32c6bfdb-62e8-4556-af6e-84f59ab39f29\") "
Jul 28 13:23:36.509069 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:36.509043    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32c6bfdb-62e8-4556-af6e-84f59ab39f29-kube-api-access-5nr4c" (OuterVolumeSpecName: "kube-api-access-5nr4c") pod "32c6bfdb-62e8-4556-af6e-84f59ab39f29" (UID: "32c6bfdb-62e8-4556-af6e-84f59ab39f29"). InnerVolumeSpecName "kube-api-access-5nr4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:23:36.607854 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:36.607747    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nr4c\" (UniqueName: \"kubernetes.io/projected/32c6bfdb-62e8-4556-af6e-84f59ab39f29-kube-api-access-5nr4c\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:23:37.289439 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:37.289400    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767179312"
Jul 28 13:23:37.289648 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:37.289399    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fb1ba1f6a568984c20d606110c3ed4ddad68b9ae6e87d76a1542bb2ccdd653e"
Jul 28 13:23:37.299256 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:23:37.299217    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7487-140018767179312\" is forbidden: User \"system:node:ip-10-0-128-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-176.ec2.internal' and this object" podUID="32c6bfdb-62e8-4556-af6e-84f59ab39f29" pod="opendatahub/test-curl-7487-140018767179312"
Jul 28 13:23:37.901081 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:37.901047    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32c6bfdb-62e8-4556-af6e-84f59ab39f29" path="/var/lib/kubelet/pods/32c6bfdb-62e8-4556-af6e-84f59ab39f29/volumes"
Jul 28 13:23:42.414582 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.414539    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7487-140018767128592"]
Jul 28 13:23:42.414974 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.414959    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32c6bfdb-62e8-4556-af6e-84f59ab39f29" containerName="test-curl-7487-140018767179312"
Jul 28 13:23:42.414974 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.414989    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="32c6bfdb-62e8-4556-af6e-84f59ab39f29" containerName="test-curl-7487-140018767179312"
Jul 28 13:23:42.415098 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.415053    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="32c6bfdb-62e8-4556-af6e-84f59ab39f29" containerName="test-curl-7487-140018767179312"
Jul 28 13:23:42.418416 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.418393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767128592"
Jul 28 13:23:42.420730 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.420706    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zcgkh\""
Jul 28 13:23:42.424443 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.424414    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7487-140018767128592"]
Jul 28 13:23:42.567115 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.567071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf56w\" (UniqueName: \"kubernetes.io/projected/f6876715-a77e-4ce8-8bff-42ba9b979274-kube-api-access-tf56w\") pod \"test-curl-7487-140018767128592\" (UID: \"f6876715-a77e-4ce8-8bff-42ba9b979274\") " pod="opendatahub/test-curl-7487-140018767128592"
Jul 28 13:23:42.668180 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.668069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf56w\" (UniqueName: \"kubernetes.io/projected/f6876715-a77e-4ce8-8bff-42ba9b979274-kube-api-access-tf56w\") pod \"test-curl-7487-140018767128592\" (UID: \"f6876715-a77e-4ce8-8bff-42ba9b979274\") " pod="opendatahub/test-curl-7487-140018767128592"
Jul 28 13:23:42.676406 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.676383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf56w\" (UniqueName: \"kubernetes.io/projected/f6876715-a77e-4ce8-8bff-42ba9b979274-kube-api-access-tf56w\") pod \"test-curl-7487-140018767128592\" (UID: \"f6876715-a77e-4ce8-8bff-42ba9b979274\") " pod="opendatahub/test-curl-7487-140018767128592"
Jul 28 13:23:42.729874 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.729835    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767128592"
Jul 28 13:23:42.881655 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:42.881630    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7487-140018767128592"]
Jul 28 13:23:42.883965 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:23:42.883934    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6876715_a77e_4ce8_8bff_42ba9b979274.slice/crio-fc46a7b1f7f6b40b2ebc2ac306a5741181c4c7f6c71918b7bc167a2f0da8fb40 WatchSource:0}: Error finding container fc46a7b1f7f6b40b2ebc2ac306a5741181c4c7f6c71918b7bc167a2f0da8fb40: Status 404 returned error can't find the container with id fc46a7b1f7f6b40b2ebc2ac306a5741181c4c7f6c71918b7bc167a2f0da8fb40
Jul 28 13:23:43.325797 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:43.325762    2565 generic.go:356] "Generic (PLEG): container finished" podID="f6876715-a77e-4ce8-8bff-42ba9b979274" containerID="dba2cf83df1b13c1693ec97608741571f13b3800bb85286e3a4648a1d841f681" exitCode=0
Jul 28 13:23:43.326021 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:43.325858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7487-140018767128592" event={"ID":"f6876715-a77e-4ce8-8bff-42ba9b979274","Type":"ContainerDied","Data":"dba2cf83df1b13c1693ec97608741571f13b3800bb85286e3a4648a1d841f681"}
Jul 28 13:23:43.326021 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:43.325900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7487-140018767128592" event={"ID":"f6876715-a77e-4ce8-8bff-42ba9b979274","Type":"ContainerStarted","Data":"fc46a7b1f7f6b40b2ebc2ac306a5741181c4c7f6c71918b7bc167a2f0da8fb40"}
Jul 28 13:23:44.478535 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.478509    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767128592"
Jul 28 13:23:44.499763 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.499704    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7487-140018767128592_f6876715-a77e-4ce8-8bff-42ba9b979274/test-curl-7487-140018767128592/0.log"
Jul 28 13:23:44.527027 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.526957    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7487-140018767128592"]
Jul 28 13:23:44.530801 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.530761    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7487-140018767128592"]
Jul 28 13:23:44.587701 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.587603    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf56w\" (UniqueName: \"kubernetes.io/projected/f6876715-a77e-4ce8-8bff-42ba9b979274-kube-api-access-tf56w\") pod \"f6876715-a77e-4ce8-8bff-42ba9b979274\" (UID: \"f6876715-a77e-4ce8-8bff-42ba9b979274\") "
Jul 28 13:23:44.589929 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.589900    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6876715-a77e-4ce8-8bff-42ba9b979274-kube-api-access-tf56w" (OuterVolumeSpecName: "kube-api-access-tf56w") pod "f6876715-a77e-4ce8-8bff-42ba9b979274" (UID: "f6876715-a77e-4ce8-8bff-42ba9b979274"). InnerVolumeSpecName "kube-api-access-tf56w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:23:44.656927 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.656888    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7487-140018767129600"]
Jul 28 13:23:44.657323 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.657309    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6876715-a77e-4ce8-8bff-42ba9b979274" containerName="test-curl-7487-140018767128592"
Jul 28 13:23:44.657373 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.657325    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6876715-a77e-4ce8-8bff-42ba9b979274" containerName="test-curl-7487-140018767128592"
Jul 28 13:23:44.657415 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.657394    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6876715-a77e-4ce8-8bff-42ba9b979274" containerName="test-curl-7487-140018767128592"
Jul 28 13:23:44.660473 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.660453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:44.668149 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.668013    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7487-140018767129600"]
Jul 28 13:23:44.689297 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.689268    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf56w\" (UniqueName: \"kubernetes.io/projected/f6876715-a77e-4ce8-8bff-42ba9b979274-kube-api-access-tf56w\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:23:44.790751 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.790711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9722\" (UniqueName: \"kubernetes.io/projected/f12398c5-2c48-4f44-879b-a544b6fdaa71-kube-api-access-d9722\") pod \"test-curl-7487-140018767129600\" (UID: \"f12398c5-2c48-4f44-879b-a544b6fdaa71\") " pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:44.891942 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.891851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9722\" (UniqueName: \"kubernetes.io/projected/f12398c5-2c48-4f44-879b-a544b6fdaa71-kube-api-access-d9722\") pod \"test-curl-7487-140018767129600\" (UID: \"f12398c5-2c48-4f44-879b-a544b6fdaa71\") " pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:44.899964 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.899938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9722\" (UniqueName: \"kubernetes.io/projected/f12398c5-2c48-4f44-879b-a544b6fdaa71-kube-api-access-d9722\") pod \"test-curl-7487-140018767129600\" (UID: \"f12398c5-2c48-4f44-879b-a544b6fdaa71\") " pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:44.972331 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:44.972297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:45.114687 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:45.114657    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7487-140018767129600"]
Jul 28 13:23:45.117009 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:23:45.116957    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf12398c5_2c48_4f44_879b_a544b6fdaa71.slice/crio-77d6e5325e8605f5319012424fcd0766e754753bc48555fd14448207cab544dc WatchSource:0}: Error finding container 77d6e5325e8605f5319012424fcd0766e754753bc48555fd14448207cab544dc: Status 404 returned error can't find the container with id 77d6e5325e8605f5319012424fcd0766e754753bc48555fd14448207cab544dc
Jul 28 13:23:45.338032 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:45.337961    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7487-140018767129600" event={"ID":"f12398c5-2c48-4f44-879b-a544b6fdaa71","Type":"ContainerStarted","Data":"77d6e5325e8605f5319012424fcd0766e754753bc48555fd14448207cab544dc"}
Jul 28 13:23:45.339561 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:45.339535    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767128592"
Jul 28 13:23:45.339734 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:45.339568    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc46a7b1f7f6b40b2ebc2ac306a5741181c4c7f6c71918b7bc167a2f0da8fb40"
Jul 28 13:23:45.350253 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:23:45.350220    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7487-140018767128592\" is forbidden: User \"system:node:ip-10-0-128-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-176.ec2.internal' and this object" podUID="f6876715-a77e-4ce8-8bff-42ba9b979274" pod="opendatahub/test-curl-7487-140018767128592"
Jul 28 13:23:45.900536 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:45.900492    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6876715-a77e-4ce8-8bff-42ba9b979274" path="/var/lib/kubelet/pods/f6876715-a77e-4ce8-8bff-42ba9b979274/volumes"
Jul 28 13:23:46.347203 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:46.346803    2565 generic.go:356] "Generic (PLEG): container finished" podID="f12398c5-2c48-4f44-879b-a544b6fdaa71" containerID="b9247b0f214342ec4678fe4e2315d3585376d196f88e5a5b9eb3a7b3f1f0dc8c" exitCode=0
Jul 28 13:23:46.347203 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:46.346877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7487-140018767129600" event={"ID":"f12398c5-2c48-4f44-879b-a544b6fdaa71","Type":"ContainerDied","Data":"b9247b0f214342ec4678fe4e2315d3585376d196f88e5a5b9eb3a7b3f1f0dc8c"}
Jul 28 13:23:46.783240 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:46.783153    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4" podUID="f166296f-e49b-4619-bf8b-3e855e901179" containerName="main" containerID="cri-o://d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432" gracePeriod=45
Jul 28 13:23:47.048464 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.048396    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:23:47.214013 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.213945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f166296f-e49b-4619-bf8b-3e855e901179-tls-certs\") pod \"f166296f-e49b-4619-bf8b-3e855e901179\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") "
Jul 28 13:23:47.214196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.214030    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-dshm\") pod \"f166296f-e49b-4619-bf8b-3e855e901179\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") "
Jul 28 13:23:47.214196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.214085    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvwfm\" (UniqueName: \"kubernetes.io/projected/f166296f-e49b-4619-bf8b-3e855e901179-kube-api-access-rvwfm\") pod \"f166296f-e49b-4619-bf8b-3e855e901179\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") "
Jul 28 13:23:47.214196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.214122    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-tmp-dir\") pod \"f166296f-e49b-4619-bf8b-3e855e901179\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") "
Jul 28 13:23:47.214196 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.214194    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-home\") pod \"f166296f-e49b-4619-bf8b-3e855e901179\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") "
Jul 28 13:23:47.214432 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.214248    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-model-cache\") pod \"f166296f-e49b-4619-bf8b-3e855e901179\" (UID: \"f166296f-e49b-4619-bf8b-3e855e901179\") "
Jul 28 13:23:47.214487 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.214431    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f166296f-e49b-4619-bf8b-3e855e901179" (UID: "f166296f-e49b-4619-bf8b-3e855e901179"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:23:47.214549 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.214481    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-home" (OuterVolumeSpecName: "home") pod "f166296f-e49b-4619-bf8b-3e855e901179" (UID: "f166296f-e49b-4619-bf8b-3e855e901179"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:23:47.214677 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.214657    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-model-cache" (OuterVolumeSpecName: "model-cache") pod "f166296f-e49b-4619-bf8b-3e855e901179" (UID: "f166296f-e49b-4619-bf8b-3e855e901179"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:23:47.214764 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.214683    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-tmp-dir\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:23:47.214764 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.214706    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-home\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:23:47.216334 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.216313    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f166296f-e49b-4619-bf8b-3e855e901179-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f166296f-e49b-4619-bf8b-3e855e901179" (UID: "f166296f-e49b-4619-bf8b-3e855e901179"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:23:47.216873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.216855    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-dshm" (OuterVolumeSpecName: "dshm") pod "f166296f-e49b-4619-bf8b-3e855e901179" (UID: "f166296f-e49b-4619-bf8b-3e855e901179"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:23:47.216956 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.216854    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f166296f-e49b-4619-bf8b-3e855e901179-kube-api-access-rvwfm" (OuterVolumeSpecName: "kube-api-access-rvwfm") pod "f166296f-e49b-4619-bf8b-3e855e901179" (UID: "f166296f-e49b-4619-bf8b-3e855e901179"). InnerVolumeSpecName "kube-api-access-rvwfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:23:47.315495 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.315400    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f166296f-e49b-4619-bf8b-3e855e901179-tls-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:23:47.315495 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.315433    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-dshm\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:23:47.315495 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.315442    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvwfm\" (UniqueName: \"kubernetes.io/projected/f166296f-e49b-4619-bf8b-3e855e901179-kube-api-access-rvwfm\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:23:47.315495 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.315452    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f166296f-e49b-4619-bf8b-3e855e901179-model-cache\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:23:47.353560 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.353517    2565 generic.go:356] "Generic (PLEG): container finished" podID="f166296f-e49b-4619-bf8b-3e855e901179" containerID="d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432" exitCode=0
Jul 28 13:23:47.353560 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.353551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4" event={"ID":"f166296f-e49b-4619-bf8b-3e855e901179","Type":"ContainerDied","Data":"d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432"}
Jul 28 13:23:47.353560 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.353565    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"
Jul 28 13:23:47.353859 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.353595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4" event={"ID":"f166296f-e49b-4619-bf8b-3e855e901179","Type":"ContainerDied","Data":"5ed2fdcd841ded1acb8edc8e302bf741762df14dd2a1cbebc78c396779fb838d"}
Jul 28 13:23:47.353859 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.353614    2565 scope.go:117] "RemoveContainer" containerID="d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432"
Jul 28 13:23:47.364008 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.363954    2565 scope.go:117] "RemoveContainer" containerID="d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432"
Jul 28 13:23:47.364394 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:23:47.364367    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432\": container with ID starting with d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432 not found: ID does not exist" containerID="d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432"
Jul 28 13:23:47.364494 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.364415    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432"} err="failed to get container status \"d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432\": rpc error: code = NotFound desc = could not find container \"d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432\": container with ID starting with d2f63cac014a3bf6e84d412b09d759df4d6cbf715a9ce22761340deb60c0a432 not found: ID does not exist"
Jul 28 13:23:47.376970 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.376935    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"]
Jul 28 13:23:47.385179 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.385150    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-67d68f/rate-test-model-67d68f-kserve-5b7b788d8c-mnxd4"]
Jul 28 13:23:47.504784 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.504754    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:47.524025 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.523967    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7487-140018767129600_f12398c5-2c48-4f44-879b-a544b6fdaa71/test-curl-7487-140018767129600/0.log"
Jul 28 13:23:47.550699 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.550664    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7487-140018767129600"]
Jul 28 13:23:47.558396 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.558370    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7487-140018767129600"]
Jul 28 13:23:47.618846 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.618751    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9722\" (UniqueName: \"kubernetes.io/projected/f12398c5-2c48-4f44-879b-a544b6fdaa71-kube-api-access-d9722\") pod \"f12398c5-2c48-4f44-879b-a544b6fdaa71\" (UID: \"f12398c5-2c48-4f44-879b-a544b6fdaa71\") "
Jul 28 13:23:47.621099 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.621070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f12398c5-2c48-4f44-879b-a544b6fdaa71-kube-api-access-d9722" (OuterVolumeSpecName: "kube-api-access-d9722") pod "f12398c5-2c48-4f44-879b-a544b6fdaa71" (UID: "f12398c5-2c48-4f44-879b-a544b6fdaa71"). InnerVolumeSpecName "kube-api-access-d9722". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:23:47.687894 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.687854    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7487-140018767129600"]
Jul 28 13:23:47.688585 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.688562    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f12398c5-2c48-4f44-879b-a544b6fdaa71" containerName="test-curl-7487-140018767129600"
Jul 28 13:23:47.688636 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.688590    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f12398c5-2c48-4f44-879b-a544b6fdaa71" containerName="test-curl-7487-140018767129600"
Jul 28 13:23:47.688636 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.688609    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f166296f-e49b-4619-bf8b-3e855e901179" containerName="main"
Jul 28 13:23:47.688636 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.688618    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f166296f-e49b-4619-bf8b-3e855e901179" containerName="main"
Jul 28 13:23:47.688759 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.688746    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f12398c5-2c48-4f44-879b-a544b6fdaa71" containerName="test-curl-7487-140018767129600"
Jul 28 13:23:47.688791 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.688765    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f166296f-e49b-4619-bf8b-3e855e901179" containerName="main"
Jul 28 13:23:47.692405 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.692375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:47.695427 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.695400    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7487-140018767129600"]
Jul 28 13:23:47.719495 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.719463    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9722\" (UniqueName: \"kubernetes.io/projected/f12398c5-2c48-4f44-879b-a544b6fdaa71-kube-api-access-d9722\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:23:47.820869 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.820818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l9v4\" (UniqueName: \"kubernetes.io/projected/5d443f76-4b6c-4093-8e3f-2e49b937faa5-kube-api-access-8l9v4\") pod \"test-curl-7487-140018767129600\" (UID: \"5d443f76-4b6c-4093-8e3f-2e49b937faa5\") " pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:47.901284 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.901179    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f12398c5-2c48-4f44-879b-a544b6fdaa71" path="/var/lib/kubelet/pods/f12398c5-2c48-4f44-879b-a544b6fdaa71/volumes"
Jul 28 13:23:47.901709 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.901684    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f166296f-e49b-4619-bf8b-3e855e901179" path="/var/lib/kubelet/pods/f166296f-e49b-4619-bf8b-3e855e901179/volumes"
Jul 28 13:23:47.921881 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.921833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l9v4\" (UniqueName: \"kubernetes.io/projected/5d443f76-4b6c-4093-8e3f-2e49b937faa5-kube-api-access-8l9v4\") pod \"test-curl-7487-140018767129600\" (UID: \"5d443f76-4b6c-4093-8e3f-2e49b937faa5\") " pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:47.929845 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:47.929817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l9v4\" (UniqueName: \"kubernetes.io/projected/5d443f76-4b6c-4093-8e3f-2e49b937faa5-kube-api-access-8l9v4\") pod \"test-curl-7487-140018767129600\" (UID: \"5d443f76-4b6c-4093-8e3f-2e49b937faa5\") " pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:48.003700 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:48.003661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:48.148200 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:48.148175    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7487-140018767129600"]
Jul 28 13:23:48.150403 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:23:48.150375    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d443f76_4b6c_4093_8e3f_2e49b937faa5.slice/crio-cef02bd5d0e440be561c59f8ba706f27db7208204464593f48ab5842ae7afb83 WatchSource:0}: Error finding container cef02bd5d0e440be561c59f8ba706f27db7208204464593f48ab5842ae7afb83: Status 404 returned error can't find the container with id cef02bd5d0e440be561c59f8ba706f27db7208204464593f48ab5842ae7afb83
Jul 28 13:23:48.361381 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:48.361353    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:48.361561 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:48.361416    2565 scope.go:117] "RemoveContainer" containerID="b9247b0f214342ec4678fe4e2315d3585376d196f88e5a5b9eb3a7b3f1f0dc8c"
Jul 28 13:23:48.362653 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:48.362615    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7487-140018767129600" event={"ID":"5d443f76-4b6c-4093-8e3f-2e49b937faa5","Type":"ContainerStarted","Data":"cef02bd5d0e440be561c59f8ba706f27db7208204464593f48ab5842ae7afb83"}
Jul 28 13:23:49.371615 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:49.371581    2565 generic.go:356] "Generic (PLEG): container finished" podID="5d443f76-4b6c-4093-8e3f-2e49b937faa5" containerID="583776d208d65de44b12955d342ccf217b55853b7c989ccdd3083e1a690044ba" exitCode=0
Jul 28 13:23:49.372110 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:49.371673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7487-140018767129600" event={"ID":"5d443f76-4b6c-4093-8e3f-2e49b937faa5","Type":"ContainerDied","Data":"583776d208d65de44b12955d342ccf217b55853b7c989ccdd3083e1a690044ba"}
Jul 28 13:23:50.512174 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:50.512150    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:50.533521 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:50.533492    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7487-140018767129600_5d443f76-4b6c-4093-8e3f-2e49b937faa5/test-curl-7487-140018767129600/0.log"
Jul 28 13:23:50.559507 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:50.559465    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7487-140018767129600"]
Jul 28 13:23:50.561500 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:50.561476    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7487-140018767129600"]
Jul 28 13:23:50.648957 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:50.648869    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l9v4\" (UniqueName: \"kubernetes.io/projected/5d443f76-4b6c-4093-8e3f-2e49b937faa5-kube-api-access-8l9v4\") pod \"5d443f76-4b6c-4093-8e3f-2e49b937faa5\" (UID: \"5d443f76-4b6c-4093-8e3f-2e49b937faa5\") "
Jul 28 13:23:50.651219 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:50.651192    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d443f76-4b6c-4093-8e3f-2e49b937faa5-kube-api-access-8l9v4" (OuterVolumeSpecName: "kube-api-access-8l9v4") pod "5d443f76-4b6c-4093-8e3f-2e49b937faa5" (UID: "5d443f76-4b6c-4093-8e3f-2e49b937faa5"). InnerVolumeSpecName "kube-api-access-8l9v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:23:50.749967 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:50.749931    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l9v4\" (UniqueName: \"kubernetes.io/projected/5d443f76-4b6c-4093-8e3f-2e49b937faa5-kube-api-access-8l9v4\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:23:51.071682 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.071644    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:51.361281 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.361192    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"]
Jul 28 13:23:51.361653 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.361638    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d443f76-4b6c-4093-8e3f-2e49b937faa5" containerName="test-curl-7487-140018767129600"
Jul 28 13:23:51.361711 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.361655    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d443f76-4b6c-4093-8e3f-2e49b937faa5" containerName="test-curl-7487-140018767129600"
Jul 28 13:23:51.361746 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.361717    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d443f76-4b6c-4093-8e3f-2e49b937faa5" containerName="test-curl-7487-140018767129600"
Jul 28 13:23:51.364965 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.364942    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.367365 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.367336    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-8fb56b-openshift-default-dockercfg-d8m4d\""
Jul 28 13:23:51.370415 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.370387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:51.376279 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.376251    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"]
Jul 28 13:23:51.384944 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.384920    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cef02bd5d0e440be561c59f8ba706f27db7208204464593f48ab5842ae7afb83"
Jul 28 13:23:51.385162 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.384992    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:51.399162 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:23:51.399121    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7487-140018767129600\" is forbidden: User \"system:node:ip-10-0-128-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-176.ec2.internal' and this object" podUID="5d443f76-4b6c-4093-8e3f-2e49b937faa5" pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:51.455748 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.455704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-data\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.455970 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.455758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-token\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.455970 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.455797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-credential-socket\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.455970 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.455871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-certs\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.455970 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.455946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-socket\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.456210 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.456022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-envoy\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.456210 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.456056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2mzg\" (UniqueName: \"kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-kube-api-access-r2mzg\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.456210 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.456125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-podinfo\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.456210 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.456191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6412e209-40c0-4d1c-8e97-c8519c5034b1-istiod-ca-cert\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.557146 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6412e209-40c0-4d1c-8e97-c8519c5034b1-istiod-ca-cert\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.557654 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-data\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.557654 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-token\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.557654 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-credential-socket\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.557654 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-certs\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.557654 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-socket\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.557654 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-envoy\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.557654 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2mzg\" (UniqueName: \"kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-kube-api-access-r2mzg\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.558094 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-data\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.558094 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-podinfo\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.558094 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.557752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-certs\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.558094 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.558018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-socket\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.558094 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.558054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-credential-socket\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.558534 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.558102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6412e209-40c0-4d1c-8e97-c8519c5034b1-istiod-ca-cert\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.560171 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.560149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-envoy\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.560457 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.560437    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-podinfo\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.565583 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.565549    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-token\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.565689 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.565677    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2mzg\" (UniqueName: \"kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-kube-api-access-r2mzg\") pod \"e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") " pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.677818 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.677713    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:51.837179 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.837153    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"]
Jul 28 13:23:51.839191 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:23:51.839147    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6412e209_40c0_4d1c_8e97_c8519c5034b1.slice/crio-50591545187a38b72b25f27701cbcf5c9d8457fd43fa904d67de08f2e2f37dcf WatchSource:0}: Error finding container 50591545187a38b72b25f27701cbcf5c9d8457fd43fa904d67de08f2e2f37dcf: Status 404 returned error can't find the container with id 50591545187a38b72b25f27701cbcf5c9d8457fd43fa904d67de08f2e2f37dcf
Jul 28 13:23:51.842157 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.842118    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:23:51.842294 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.842213    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:23:51.842294 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.842251    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:23:51.899229 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:23:51.899189    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7487-140018767129600\" is forbidden: User \"system:node:ip-10-0-128-176.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-176.ec2.internal' and this object" podUID="5d443f76-4b6c-4093-8e3f-2e49b937faa5" pod="opendatahub/test-curl-7487-140018767129600"
Jul 28 13:23:51.901298 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:51.901274    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d443f76-4b6c-4093-8e3f-2e49b937faa5" path="/var/lib/kubelet/pods/5d443f76-4b6c-4093-8e3f-2e49b937faa5/volumes"
Jul 28 13:23:52.198348 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:52.198315    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:52.391185 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:52.391148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" event={"ID":"6412e209-40c0-4d1c-8e97-c8519c5034b1","Type":"ContainerStarted","Data":"4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d"}
Jul 28 13:23:52.391373 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:52.391202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" event={"ID":"6412e209-40c0-4d1c-8e97-c8519c5034b1","Type":"ContainerStarted","Data":"50591545187a38b72b25f27701cbcf5c9d8457fd43fa904d67de08f2e2f37dcf"}
Jul 28 13:23:52.414396 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:52.414340    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" podStartSLOduration=1.414324209 podStartE2EDuration="1.414324209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:23:52.411817576 +0000 UTC m=+3241.021683284" watchObservedRunningTime="2026-07-28 13:23:52.414324209 +0000 UTC m=+3241.024189916"
Jul 28 13:23:52.678137 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:52.678034    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:52.683664 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:52.683636    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:53.396845 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:53.396809    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:53.397812 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:53.397793    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:23:54.382095 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:54.382047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:54.602488 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:54.602459    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:54.719078 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:54.719033    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:54.820392 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:54.820362    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:55.159616 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.159520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:55.255143 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.255090    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:55.291787 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.291727    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"]
Jul 28 13:23:55.297632 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.297602    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:23:55.300520 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.300236    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-8fb56b-dockercfg-ccnx4\""
Jul 28 13:23:55.300947 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.300861    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-8fb56b\""
Jul 28 13:23:55.305835 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.305812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"]
Jul 28 13:23:55.396360 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.396325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fbln\" (UniqueName: \"kubernetes.io/projected/ba13166e-568b-459b-9ce4-2d5b857c9926-kube-api-access-6fbln\") pod \"payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n\" (UID: \"ba13166e-568b-459b-9ce4-2d5b857c9926\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:23:55.396799 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.396500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba13166e-568b-459b-9ce4-2d5b857c9926-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n\" (UID: \"ba13166e-568b-459b-9ce4-2d5b857c9926\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:23:55.497884 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.497845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba13166e-568b-459b-9ce4-2d5b857c9926-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n\" (UID: \"ba13166e-568b-459b-9ce4-2d5b857c9926\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:23:55.498132 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.497937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fbln\" (UniqueName: \"kubernetes.io/projected/ba13166e-568b-459b-9ce4-2d5b857c9926-kube-api-access-6fbln\") pod \"payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n\" (UID: \"ba13166e-568b-459b-9ce4-2d5b857c9926\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:23:55.498642 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.498618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba13166e-568b-459b-9ce4-2d5b857c9926-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n\" (UID: \"ba13166e-568b-459b-9ce4-2d5b857c9926\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:23:55.505609 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.505574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fbln\" (UniqueName: \"kubernetes.io/projected/ba13166e-568b-459b-9ce4-2d5b857c9926-kube-api-access-6fbln\") pod \"payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n\" (UID: \"ba13166e-568b-459b-9ce4-2d5b857c9926\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:23:55.615322 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.615285    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:23:55.758481 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:55.758451    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"]
Jul 28 13:23:55.760736 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:23:55.760706    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba13166e_568b_459b_9ce4_2d5b857c9926.slice/crio-0ea76f72550a14af5aaf22914a3d1df236bef73ae8100e5ee5e67dcbd0a76034 WatchSource:0}: Error finding container 0ea76f72550a14af5aaf22914a3d1df236bef73ae8100e5ee5e67dcbd0a76034: Status 404 returned error can't find the container with id 0ea76f72550a14af5aaf22914a3d1df236bef73ae8100e5ee5e67dcbd0a76034
Jul 28 13:23:56.416499 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:56.416461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n" event={"ID":"ba13166e-568b-459b-9ce4-2d5b857c9926","Type":"ContainerStarted","Data":"aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5"}
Jul 28 13:23:56.416893 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:56.416528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n" event={"ID":"ba13166e-568b-459b-9ce4-2d5b857c9926","Type":"ContainerStarted","Data":"0ea76f72550a14af5aaf22914a3d1df236bef73ae8100e5ee5e67dcbd0a76034"}
Jul 28 13:23:56.416893 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:56.416558    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:23:56.437869 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:56.437811    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n" podStartSLOduration=1.437794942 podStartE2EDuration="1.437794942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:23:56.434875843 +0000 UTC m=+3245.044741551" watchObservedRunningTime="2026-07-28 13:23:56.437794942 +0000 UTC m=+3245.047660649"
Jul 28 13:23:59.820638 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:23:59.820606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:07.424331 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:07.424295    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:24:09.855512 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:09.855475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:10.203679 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:10.203650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:10.422959 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:10.422926    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:12.505184 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:12.505147    2565 generic.go:356] "Generic (PLEG): container finished" podID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerID="4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d" exitCode=0
Jul 28 13:24:12.505658 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:12.505222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" event={"ID":"6412e209-40c0-4d1c-8e97-c8519c5034b1","Type":"ContainerDied","Data":"4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d"}
Jul 28 13:24:12.505706 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:12.505660    2565 scope.go:117] "RemoveContainer" containerID="4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d"
Jul 28 13:24:12.506868 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:12.506841    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:24:12.506928 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:12.506918    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:24:12.507002 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:12.506966    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 28 13:24:13.497776 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:13.496595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:13.519284 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:13.519245    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" event={"ID":"6412e209-40c0-4d1c-8e97-c8519c5034b1","Type":"ContainerStarted","Data":"6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5"}
Jul 28 13:24:13.597327 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:13.597289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:13.677911 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:13.677875    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:24:13.681343 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:13.681307    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 13:24:13.681664 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:13.681633    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 13:24:13.768961 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:13.768850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:14.005477 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.005443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:14.101193 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.101097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:14.105875 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.105824    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"]
Jul 28 13:24:14.110988 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.110950    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:24:14.113206 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.113184    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-06a4d2\""
Jul 28 13:24:14.113482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.113467    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-06a4d2-dockercfg-d2wph\""
Jul 28 13:24:14.125278 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.125249    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"]
Jul 28 13:24:14.146771 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.146740    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"]
Jul 28 13:24:14.150640 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.150618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:24:14.160426 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.160397    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"]
Jul 28 13:24:14.206842 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.206789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ca5f2b7-2f99-4265-849a-5ea1c9432306-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4\" (UID: \"5ca5f2b7-2f99-4265-849a-5ea1c9432306\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:24:14.207085 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.206855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb5fk\" (UniqueName: \"kubernetes.io/projected/a83f8b6e-e815-4939-a339-738b38487733-kube-api-access-wb5fk\") pod \"payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k\" (UID: \"a83f8b6e-e815-4939-a339-738b38487733\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:24:14.207085 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.206956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a83f8b6e-e815-4939-a339-738b38487733-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k\" (UID: \"a83f8b6e-e815-4939-a339-738b38487733\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:24:14.207085 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.207032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkf87\" (UniqueName: \"kubernetes.io/projected/5ca5f2b7-2f99-4265-849a-5ea1c9432306-kube-api-access-lkf87\") pod \"payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4\" (UID: \"5ca5f2b7-2f99-4265-849a-5ea1c9432306\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:24:14.308296 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.308251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a83f8b6e-e815-4939-a339-738b38487733-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k\" (UID: \"a83f8b6e-e815-4939-a339-738b38487733\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:24:14.308510 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.308317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkf87\" (UniqueName: \"kubernetes.io/projected/5ca5f2b7-2f99-4265-849a-5ea1c9432306-kube-api-access-lkf87\") pod \"payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4\" (UID: \"5ca5f2b7-2f99-4265-849a-5ea1c9432306\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:24:14.308510 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.308354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ca5f2b7-2f99-4265-849a-5ea1c9432306-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4\" (UID: \"5ca5f2b7-2f99-4265-849a-5ea1c9432306\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:24:14.308510 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.308377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb5fk\" (UniqueName: \"kubernetes.io/projected/a83f8b6e-e815-4939-a339-738b38487733-kube-api-access-wb5fk\") pod \"payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k\" (UID: \"a83f8b6e-e815-4939-a339-738b38487733\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:24:14.309297 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.309270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ca5f2b7-2f99-4265-849a-5ea1c9432306-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4\" (UID: \"5ca5f2b7-2f99-4265-849a-5ea1c9432306\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:24:14.309423 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.309284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a83f8b6e-e815-4939-a339-738b38487733-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k\" (UID: \"a83f8b6e-e815-4939-a339-738b38487733\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:24:14.316534 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.316497    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb5fk\" (UniqueName: \"kubernetes.io/projected/a83f8b6e-e815-4939-a339-738b38487733-kube-api-access-wb5fk\") pod \"payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k\" (UID: \"a83f8b6e-e815-4939-a339-738b38487733\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:24:14.316694 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.316599    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkf87\" (UniqueName: \"kubernetes.io/projected/5ca5f2b7-2f99-4265-849a-5ea1c9432306-kube-api-access-lkf87\") pod \"payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4\" (UID: \"5ca5f2b7-2f99-4265-849a-5ea1c9432306\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:24:14.421878 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.421766    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:24:14.462257 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.462218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:24:14.633145 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.633000    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"]
Jul 28 13:24:14.635356 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:24:14.635316    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca5f2b7_2f99_4265_849a_5ea1c9432306.slice/crio-125246c93b9d1f0cc92a753ce40daac39791a0fc340cc8eeeee4f3ca5e650194 WatchSource:0}: Error finding container 125246c93b9d1f0cc92a753ce40daac39791a0fc340cc8eeeee4f3ca5e650194: Status 404 returned error can't find the container with id 125246c93b9d1f0cc92a753ce40daac39791a0fc340cc8eeeee4f3ca5e650194
Jul 28 13:24:14.678313 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.678217    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 13:24:14.678313 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.678294    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 13:24:14.709326 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:14.709273    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"]
Jul 28 13:24:14.709591 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:24:14.709554    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda83f8b6e_e815_4939_a339_738b38487733.slice/crio-5e66d414e006e44ae6d49f298b522a14b8a8e9fce12868b131c40ba89d01ecb4 WatchSource:0}: Error finding container 5e66d414e006e44ae6d49f298b522a14b8a8e9fce12868b131c40ba89d01ecb4: Status 404 returned error can't find the container with id 5e66d414e006e44ae6d49f298b522a14b8a8e9fce12868b131c40ba89d01ecb4
Jul 28 13:24:15.533360 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:15.533317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k" event={"ID":"a83f8b6e-e815-4939-a339-738b38487733","Type":"ContainerStarted","Data":"17e072d5272a634bf732bb115ff84ae914746faf85aeeeb3a341d4f3ccff4451"}
Jul 28 13:24:15.533597 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:15.533428    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k" event={"ID":"a83f8b6e-e815-4939-a339-738b38487733","Type":"ContainerStarted","Data":"5e66d414e006e44ae6d49f298b522a14b8a8e9fce12868b131c40ba89d01ecb4"}
Jul 28 13:24:15.533597 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:15.533460    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:24:15.535051 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:15.535015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4" event={"ID":"5ca5f2b7-2f99-4265-849a-5ea1c9432306","Type":"ContainerStarted","Data":"bdd419c07e400daa762e3c337f54a4064f32bccb15aa91f96a62f57647721143"}
Jul 28 13:24:15.535116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:15.535077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4" event={"ID":"5ca5f2b7-2f99-4265-849a-5ea1c9432306","Type":"ContainerStarted","Data":"125246c93b9d1f0cc92a753ce40daac39791a0fc340cc8eeeee4f3ca5e650194"}
Jul 28 13:24:15.535158 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:15.535114    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:24:15.554443 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:15.554384    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k" podStartSLOduration=1.55436283 podStartE2EDuration="1.55436283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:24:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:24:15.551333463 +0000 UTC m=+3264.161199171" watchObservedRunningTime="2026-07-28 13:24:15.55436283 +0000 UTC m=+3264.164228540"
Jul 28 13:24:15.566658 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:15.566600    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4" podStartSLOduration=1.566581532 podStartE2EDuration="1.566581532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:24:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:24:15.565449798 +0000 UTC m=+3264.175315507" watchObservedRunningTime="2026-07-28 13:24:15.566581532 +0000 UTC m=+3264.176447239"
Jul 28 13:24:15.678379 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:15.678343    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 13:24:15.678805 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:15.678407    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 13:24:16.679125 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:16.679084    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 13:24:16.679643 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:16.679184    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 13:24:17.678887 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:17.678847    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 28 13:24:17.679141 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:17.678926    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 28 13:24:17.824193 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:17.824156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:18.682782 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:18.682752    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:24:18.683229 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:18.683166    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:24:18.683973 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:18.683948    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:24:26.543011 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:26.542961    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:24:26.543483 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:26.543067    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:24:35.103526 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:35.103497    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8vw2x_f83412d3-3120-4c48-9ce2-ab14ed74a60e/payload-processing/0.log"
Jul 28 13:24:35.222729 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:35.222669    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k_a83f8b6e-e815-4939-a339-738b38487733/payload-processing/0.log"
Jul 28 13:24:38.321058 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:38.321024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:52.574224 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:52.574184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:52.674119 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:24:52.674069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:01.691649 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:01.691614    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:25:01.695559 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:01.695534    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:25:22.172631 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:22.172542    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n_ba13166e-568b-459b-9ce4-2d5b857c9926/payload-processing/0.log"
Jul 28 13:25:22.297763 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:22.297716    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8vw2x_f83412d3-3120-4c48-9ce2-ab14ed74a60e/payload-processing/0.log"
Jul 28 13:25:22.419816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:22.419787    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k_a83f8b6e-e815-4939-a339-738b38487733/payload-processing/0.log"
Jul 28 13:25:22.704350 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:22.704301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:23.057714 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:23.057612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:23.254785 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:23.254747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:25.677300 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:25.677266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:25.780065 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:25.780031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:25.872536 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:25.872503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:26.107519 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.107479    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:26.390062 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.389956    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:26.507057 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.507013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:26.624468 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.624428    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"]
Jul 28 13:25:26.628383 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.628359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:26.631950 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.631922    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-33eb65\""
Jul 28 13:25:26.647625 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.647546    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"]
Jul 28 13:25:26.722039 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.721988    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"]
Jul 28 13:25:26.725574 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.725551    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:26.728322 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.728288    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-33eb65-dockercfg-n96js\""
Jul 28 13:25:26.740207 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.740170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b26970f6-315c-4d51-a803-8461d752a04e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28\" (UID: \"b26970f6-315c-4d51-a803-8461d752a04e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:26.740387 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.740227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m4vr\" (UniqueName: \"kubernetes.io/projected/b26970f6-315c-4d51-a803-8461d752a04e-kube-api-access-4m4vr\") pod \"payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28\" (UID: \"b26970f6-315c-4d51-a803-8461d752a04e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:26.746053 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.746021    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"]
Jul 28 13:25:26.841534 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.841480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nmm9\" (UniqueName: \"kubernetes.io/projected/1c7c9288-7c03-4062-8f09-80bd00eb18fd-kube-api-access-5nmm9\") pod \"payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5\" (UID: \"1c7c9288-7c03-4062-8f09-80bd00eb18fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:26.841752 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.841570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b26970f6-315c-4d51-a803-8461d752a04e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28\" (UID: \"b26970f6-315c-4d51-a803-8461d752a04e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:26.841752 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.841608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c7c9288-7c03-4062-8f09-80bd00eb18fd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5\" (UID: \"1c7c9288-7c03-4062-8f09-80bd00eb18fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:26.841752 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.841657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m4vr\" (UniqueName: \"kubernetes.io/projected/b26970f6-315c-4d51-a803-8461d752a04e-kube-api-access-4m4vr\") pod \"payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28\" (UID: \"b26970f6-315c-4d51-a803-8461d752a04e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:26.842346 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.842325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b26970f6-315c-4d51-a803-8461d752a04e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28\" (UID: \"b26970f6-315c-4d51-a803-8461d752a04e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:26.853098 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.853063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m4vr\" (UniqueName: \"kubernetes.io/projected/b26970f6-315c-4d51-a803-8461d752a04e-kube-api-access-4m4vr\") pod \"payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28\" (UID: \"b26970f6-315c-4d51-a803-8461d752a04e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:26.940055 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.939919    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:26.942404 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.942369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nmm9\" (UniqueName: \"kubernetes.io/projected/1c7c9288-7c03-4062-8f09-80bd00eb18fd-kube-api-access-5nmm9\") pod \"payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5\" (UID: \"1c7c9288-7c03-4062-8f09-80bd00eb18fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:26.942555 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.942474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c7c9288-7c03-4062-8f09-80bd00eb18fd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5\" (UID: \"1c7c9288-7c03-4062-8f09-80bd00eb18fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:26.943523 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.943270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c7c9288-7c03-4062-8f09-80bd00eb18fd-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5\" (UID: \"1c7c9288-7c03-4062-8f09-80bd00eb18fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:26.950277 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:26.950245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nmm9\" (UniqueName: \"kubernetes.io/projected/1c7c9288-7c03-4062-8f09-80bd00eb18fd-kube-api-access-5nmm9\") pod \"payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5\" (UID: \"1c7c9288-7c03-4062-8f09-80bd00eb18fd\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:27.036603 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:27.036220    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:27.106588 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:27.105870    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"]
Jul 28 13:25:27.108097 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:25:27.108054    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26970f6_315c_4d51_a803_8461d752a04e.slice/crio-7b86ff8101836115626ee22b196761cf4281f5d9f2903183c739fe8202cb8a56 WatchSource:0}: Error finding container 7b86ff8101836115626ee22b196761cf4281f5d9f2903183c739fe8202cb8a56: Status 404 returned error can't find the container with id 7b86ff8101836115626ee22b196761cf4281f5d9f2903183c739fe8202cb8a56
Jul 28 13:25:27.211259 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:27.211228    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"]
Jul 28 13:25:27.214060 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:25:27.214026    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7c9288_7c03_4062_8f09_80bd00eb18fd.slice/crio-35f1325bfdf1a03aa139d1ff3a0437eef2267ae8c5432fcb7d9fc94ed656051d WatchSource:0}: Error finding container 35f1325bfdf1a03aa139d1ff3a0437eef2267ae8c5432fcb7d9fc94ed656051d: Status 404 returned error can't find the container with id 35f1325bfdf1a03aa139d1ff3a0437eef2267ae8c5432fcb7d9fc94ed656051d
Jul 28 13:25:27.931505 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:27.931466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5" event={"ID":"1c7c9288-7c03-4062-8f09-80bd00eb18fd","Type":"ContainerStarted","Data":"84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0"}
Jul 28 13:25:27.932158 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:27.931877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5" event={"ID":"1c7c9288-7c03-4062-8f09-80bd00eb18fd","Type":"ContainerStarted","Data":"35f1325bfdf1a03aa139d1ff3a0437eef2267ae8c5432fcb7d9fc94ed656051d"}
Jul 28 13:25:27.932158 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:27.931917    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:27.933577 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:27.933546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28" event={"ID":"b26970f6-315c-4d51-a803-8461d752a04e","Type":"ContainerStarted","Data":"dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94"}
Jul 28 13:25:27.933732 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:27.933603    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28" event={"ID":"b26970f6-315c-4d51-a803-8461d752a04e","Type":"ContainerStarted","Data":"7b86ff8101836115626ee22b196761cf4281f5d9f2903183c739fe8202cb8a56"}
Jul 28 13:25:27.933732 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:27.933654    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:27.968294 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:27.968236    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5" podStartSLOduration=1.96822092 podStartE2EDuration="1.96822092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:25:27.966722048 +0000 UTC m=+3336.576587757" watchObservedRunningTime="2026-07-28 13:25:27.96822092 +0000 UTC m=+3336.578086628"
Jul 28 13:25:28.004004 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:28.003917    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28" podStartSLOduration=2.003900392 podStartE2EDuration="2.003900392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:25:28.001249121 +0000 UTC m=+3336.611114832" watchObservedRunningTime="2026-07-28 13:25:28.003900392 +0000 UTC m=+3336.613766109"
Jul 28 13:25:30.193718 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:30.193681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:37.775244 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:37.775185    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:38.940694 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:38.940663    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:38.941131 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:38.940748    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:51.566843 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.566805    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:51.594509 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.594460    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"]
Jul 28 13:25:51.596242 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.596200    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5" podUID="1c7c9288-7c03-4062-8f09-80bd00eb18fd" containerName="payload-processing" containerID="cri-o://84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0" gracePeriod=30
Jul 28 13:25:51.600619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.600578    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"]
Jul 28 13:25:51.600956 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.600921    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28" podUID="b26970f6-315c-4d51-a803-8461d752a04e" containerName="payload-pre-processing" containerID="cri-o://dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94" gracePeriod=30
Jul 28 13:25:51.642609 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.642573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:51.703478 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.703432    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:51.884816 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.884786    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:51.900945 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.900612    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nmm9\" (UniqueName: \"kubernetes.io/projected/1c7c9288-7c03-4062-8f09-80bd00eb18fd-kube-api-access-5nmm9\") pod \"1c7c9288-7c03-4062-8f09-80bd00eb18fd\" (UID: \"1c7c9288-7c03-4062-8f09-80bd00eb18fd\") "
Jul 28 13:25:51.900945 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.900667    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c7c9288-7c03-4062-8f09-80bd00eb18fd-plugins-config-volume\") pod \"1c7c9288-7c03-4062-8f09-80bd00eb18fd\" (UID: \"1c7c9288-7c03-4062-8f09-80bd00eb18fd\") "
Jul 28 13:25:51.901577 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.901530    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c7c9288-7c03-4062-8f09-80bd00eb18fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1c7c9288-7c03-4062-8f09-80bd00eb18fd" (UID: "1c7c9288-7c03-4062-8f09-80bd00eb18fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:25:51.905430 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.905385    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c7c9288-7c03-4062-8f09-80bd00eb18fd-kube-api-access-5nmm9" (OuterVolumeSpecName: "kube-api-access-5nmm9") pod "1c7c9288-7c03-4062-8f09-80bd00eb18fd" (UID: "1c7c9288-7c03-4062-8f09-80bd00eb18fd"). InnerVolumeSpecName "kube-api-access-5nmm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:25:51.925912 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:51.925881    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:52.001838 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.001797    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b26970f6-315c-4d51-a803-8461d752a04e-plugins-config-volume\") pod \"b26970f6-315c-4d51-a803-8461d752a04e\" (UID: \"b26970f6-315c-4d51-a803-8461d752a04e\") "
Jul 28 13:25:52.002063 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.001942    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m4vr\" (UniqueName: \"kubernetes.io/projected/b26970f6-315c-4d51-a803-8461d752a04e-kube-api-access-4m4vr\") pod \"b26970f6-315c-4d51-a803-8461d752a04e\" (UID: \"b26970f6-315c-4d51-a803-8461d752a04e\") "
Jul 28 13:25:52.002274 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.002260    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nmm9\" (UniqueName: \"kubernetes.io/projected/1c7c9288-7c03-4062-8f09-80bd00eb18fd-kube-api-access-5nmm9\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:25:52.002329 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.002276    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c7c9288-7c03-4062-8f09-80bd00eb18fd-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:25:52.002329 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.002304    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b26970f6-315c-4d51-a803-8461d752a04e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b26970f6-315c-4d51-a803-8461d752a04e" (UID: "b26970f6-315c-4d51-a803-8461d752a04e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:25:52.004281 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.004251    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b26970f6-315c-4d51-a803-8461d752a04e-kube-api-access-4m4vr" (OuterVolumeSpecName: "kube-api-access-4m4vr") pod "b26970f6-315c-4d51-a803-8461d752a04e" (UID: "b26970f6-315c-4d51-a803-8461d752a04e"). InnerVolumeSpecName "kube-api-access-4m4vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:25:52.068153 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.068115    2565 generic.go:356] "Generic (PLEG): container finished" podID="1c7c9288-7c03-4062-8f09-80bd00eb18fd" containerID="84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0" exitCode=0
Jul 28 13:25:52.068359 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.068173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"
Jul 28 13:25:52.068359 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.068220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5" event={"ID":"1c7c9288-7c03-4062-8f09-80bd00eb18fd","Type":"ContainerDied","Data":"84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0"}
Jul 28 13:25:52.068359 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.068274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5" event={"ID":"1c7c9288-7c03-4062-8f09-80bd00eb18fd","Type":"ContainerDied","Data":"35f1325bfdf1a03aa139d1ff3a0437eef2267ae8c5432fcb7d9fc94ed656051d"}
Jul 28 13:25:52.068359 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.068307    2565 scope.go:117] "RemoveContainer" containerID="84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0"
Jul 28 13:25:52.070128 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.070102    2565 generic.go:356] "Generic (PLEG): container finished" podID="b26970f6-315c-4d51-a803-8461d752a04e" containerID="dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94" exitCode=0
Jul 28 13:25:52.070264 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.070158    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"
Jul 28 13:25:52.070264 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.070182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28" event={"ID":"b26970f6-315c-4d51-a803-8461d752a04e","Type":"ContainerDied","Data":"dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94"}
Jul 28 13:25:52.070264 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.070248    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28" event={"ID":"b26970f6-315c-4d51-a803-8461d752a04e","Type":"ContainerDied","Data":"7b86ff8101836115626ee22b196761cf4281f5d9f2903183c739fe8202cb8a56"}
Jul 28 13:25:52.079449 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.079432    2565 scope.go:117] "RemoveContainer" containerID="84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0"
Jul 28 13:25:52.079809 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:25:52.079786    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0\": container with ID starting with 84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0 not found: ID does not exist" containerID="84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0"
Jul 28 13:25:52.079869 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.079819    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0"} err="failed to get container status \"84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0\": rpc error: code = NotFound desc = could not find container \"84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0\": container with ID starting with 84686b0a3718f8bc8795d5c69995e24edaca33c570728cda70776d11a17e25b0 not found: ID does not exist"
Jul 28 13:25:52.079869 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.079838    2565 scope.go:117] "RemoveContainer" containerID="dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94"
Jul 28 13:25:52.087928 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.087837    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"]
Jul 28 13:25:52.089939 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.089912    2565 scope.go:117] "RemoveContainer" containerID="dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94"
Jul 28 13:25:52.090404 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:25:52.090381    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94\": container with ID starting with dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94 not found: ID does not exist" containerID="dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94"
Jul 28 13:25:52.090485 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.090415    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94"} err="failed to get container status \"dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94\": rpc error: code = NotFound desc = could not find container \"dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94\": container with ID starting with dff398d7eecfb1cf491699bf2608660b5ed971ce4d369ff034256c6fcb6a1a94 not found: ID does not exist"
Jul 28 13:25:52.091668 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.091644    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-33eb65-799fc955d8-qnpp5"]
Jul 28 13:25:52.100944 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.100901    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"]
Jul 28 13:25:52.102815 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.102787    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m4vr\" (UniqueName: \"kubernetes.io/projected/b26970f6-315c-4d51-a803-8461d752a04e-kube-api-access-4m4vr\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:25:52.102815 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.102816    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b26970f6-315c-4d51-a803-8461d752a04e-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:25:52.103369 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:52.103346    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-33eb65-6cf8765856-dss28"]
Jul 28 13:25:53.901047 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:53.901011    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c7c9288-7c03-4062-8f09-80bd00eb18fd" path="/var/lib/kubelet/pods/1c7c9288-7c03-4062-8f09-80bd00eb18fd/volumes"
Jul 28 13:25:53.901473 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:53.901422    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b26970f6-315c-4d51-a803-8461d752a04e" path="/var/lib/kubelet/pods/b26970f6-315c-4d51-a803-8461d752a04e/volumes"
Jul 28 13:25:56.244384 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:56.244341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:56.631755 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:25:56.631663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:02.681953 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:02.681915    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:02.813627 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:02.813590    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:03.009545 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:03.009509    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:03.272599 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:03.272508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:22.587653 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:22.587582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:22.613634 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:22.613591    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"]
Jul 28 13:26:22.613895 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:22.613865    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n" podUID="ba13166e-568b-459b-9ce4-2d5b857c9926" containerName="payload-processing" containerID="cri-o://aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5" gracePeriod=30
Jul 28 13:26:22.688886 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:22.688832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:22.790496 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:22.790446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:22.900580 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:22.900552    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:26:22.925309 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:22.925276    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fbln\" (UniqueName: \"kubernetes.io/projected/ba13166e-568b-459b-9ce4-2d5b857c9926-kube-api-access-6fbln\") pod \"ba13166e-568b-459b-9ce4-2d5b857c9926\" (UID: \"ba13166e-568b-459b-9ce4-2d5b857c9926\") "
Jul 28 13:26:22.925521 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:22.925359    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba13166e-568b-459b-9ce4-2d5b857c9926-plugins-config-volume\") pod \"ba13166e-568b-459b-9ce4-2d5b857c9926\" (UID: \"ba13166e-568b-459b-9ce4-2d5b857c9926\") "
Jul 28 13:26:22.925750 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:22.925725    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba13166e-568b-459b-9ce4-2d5b857c9926-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba13166e-568b-459b-9ce4-2d5b857c9926" (UID: "ba13166e-568b-459b-9ce4-2d5b857c9926"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:26:22.927754 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:22.927727    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba13166e-568b-459b-9ce4-2d5b857c9926-kube-api-access-6fbln" (OuterVolumeSpecName: "kube-api-access-6fbln") pod "ba13166e-568b-459b-9ce4-2d5b857c9926" (UID: "ba13166e-568b-459b-9ce4-2d5b857c9926"). InnerVolumeSpecName "kube-api-access-6fbln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:26:23.026908 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.026861    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba13166e-568b-459b-9ce4-2d5b857c9926-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:26:23.026908 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.026897    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fbln\" (UniqueName: \"kubernetes.io/projected/ba13166e-568b-459b-9ce4-2d5b857c9926-kube-api-access-6fbln\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:26:23.245509 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.245473    2565 generic.go:356] "Generic (PLEG): container finished" podID="ba13166e-568b-459b-9ce4-2d5b857c9926" containerID="aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5" exitCode=0
Jul 28 13:26:23.245705 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.245518    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"
Jul 28 13:26:23.245705 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.245560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n" event={"ID":"ba13166e-568b-459b-9ce4-2d5b857c9926","Type":"ContainerDied","Data":"aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5"}
Jul 28 13:26:23.245705 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.245618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n" event={"ID":"ba13166e-568b-459b-9ce4-2d5b857c9926","Type":"ContainerDied","Data":"0ea76f72550a14af5aaf22914a3d1df236bef73ae8100e5ee5e67dcbd0a76034"}
Jul 28 13:26:23.245705 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.245642    2565 scope.go:117] "RemoveContainer" containerID="aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5"
Jul 28 13:26:23.256064 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.256040    2565 scope.go:117] "RemoveContainer" containerID="aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5"
Jul 28 13:26:23.256412 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:26:23.256387    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5\": container with ID starting with aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5 not found: ID does not exist" containerID="aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5"
Jul 28 13:26:23.256476 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.256425    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5"} err="failed to get container status \"aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5\": rpc error: code = NotFound desc = could not find container \"aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5\": container with ID starting with aaf74ba07c80632a59df001d810e599df85f8f35961478e0708808979dd667a5 not found: ID does not exist"
Jul 28 13:26:23.267589 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.267547    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"]
Jul 28 13:26:23.271791 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.271757    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8fb56b-58f7df4cf6-z9q9n"]
Jul 28 13:26:23.900295 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:23.900261    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba13166e-568b-459b-9ce4-2d5b857c9926" path="/var/lib/kubelet/pods/ba13166e-568b-459b-9ce4-2d5b857c9926/volumes"
Jul 28 13:26:26.269738 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:26.269707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:27.230528 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:27.230494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:27.618972 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:27.618885    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:32.645845 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:26:32.645799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:10.431676 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:10.431637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:10.852316 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:10.852284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:16.496902 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:16.496864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:22.253730 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:22.253698    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:22.353111 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:22.353082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:22.588531 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:22.588440    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"]
Jul 28 13:27:22.588721 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:22.588697    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy" containerID="cri-o://6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5" gracePeriod=30
Jul 28 13:27:22.609600 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:22.609567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:22.856709 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:22.856624    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:27.860724 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.860646    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:27:27.971540 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.971501    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-podinfo\") pod \"6412e209-40c0-4d1c-8e97-c8519c5034b1\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") "
Jul 28 13:27:27.971540 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.971546    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-envoy\") pod \"6412e209-40c0-4d1c-8e97-c8519c5034b1\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") "
Jul 28 13:27:27.971766 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.971672    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6412e209-40c0-4d1c-8e97-c8519c5034b1-istiod-ca-cert\") pod \"6412e209-40c0-4d1c-8e97-c8519c5034b1\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") "
Jul 28 13:27:27.971766 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.971710    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-credential-socket\") pod \"6412e209-40c0-4d1c-8e97-c8519c5034b1\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") "
Jul 28 13:27:27.971766 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.971729    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-certs\") pod \"6412e209-40c0-4d1c-8e97-c8519c5034b1\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") "
Jul 28 13:27:27.971911 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.971782    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-socket\") pod \"6412e209-40c0-4d1c-8e97-c8519c5034b1\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") "
Jul 28 13:27:27.971911 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.971820    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2mzg\" (UniqueName: \"kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-kube-api-access-r2mzg\") pod \"6412e209-40c0-4d1c-8e97-c8519c5034b1\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") "
Jul 28 13:27:27.971911 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.971882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-data\") pod \"6412e209-40c0-4d1c-8e97-c8519c5034b1\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") "
Jul 28 13:27:27.972116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.971922    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-token\") pod \"6412e209-40c0-4d1c-8e97-c8519c5034b1\" (UID: \"6412e209-40c0-4d1c-8e97-c8519c5034b1\") "
Jul 28 13:27:27.972116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.971957    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6412e209-40c0-4d1c-8e97-c8519c5034b1" (UID: "6412e209-40c0-4d1c-8e97-c8519c5034b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:27:27.972227 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.972123    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6412e209-40c0-4d1c-8e97-c8519c5034b1" (UID: "6412e209-40c0-4d1c-8e97-c8519c5034b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:27:27.972227 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.972152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6412e209-40c0-4d1c-8e97-c8519c5034b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6412e209-40c0-4d1c-8e97-c8519c5034b1" (UID: "6412e209-40c0-4d1c-8e97-c8519c5034b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:27:27.972690 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.972611    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6412e209-40c0-4d1c-8e97-c8519c5034b1-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:27.972690 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.972636    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:27.972690 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.972651    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:27.972951 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.972646    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6412e209-40c0-4d1c-8e97-c8519c5034b1" (UID: "6412e209-40c0-4d1c-8e97-c8519c5034b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:27:27.973069 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.973039    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "6412e209-40c0-4d1c-8e97-c8519c5034b1" (UID: "6412e209-40c0-4d1c-8e97-c8519c5034b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:27:27.974162 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.974134    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6412e209-40c0-4d1c-8e97-c8519c5034b1" (UID: "6412e209-40c0-4d1c-8e97-c8519c5034b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:27:27.974250 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.974175    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-kube-api-access-r2mzg" (OuterVolumeSpecName: "kube-api-access-r2mzg") pod "6412e209-40c0-4d1c-8e97-c8519c5034b1" (UID: "6412e209-40c0-4d1c-8e97-c8519c5034b1"). InnerVolumeSpecName "kube-api-access-r2mzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:27:27.974250 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.974189    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6412e209-40c0-4d1c-8e97-c8519c5034b1" (UID: "6412e209-40c0-4d1c-8e97-c8519c5034b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:27:27.974337 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:27.974321    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "6412e209-40c0-4d1c-8e97-c8519c5034b1" (UID: "6412e209-40c0-4d1c-8e97-c8519c5034b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:27:28.074044 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.074006    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:28.074044 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.074036    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:28.074044 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.074046    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:28.074044 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.074056    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2mzg\" (UniqueName: \"kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-kube-api-access-r2mzg\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:28.074327 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.074065    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:28.074327 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.074073    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6412e209-40c0-4d1c-8e97-c8519c5034b1-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:28.608606 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.608574    2565 generic.go:356] "Generic (PLEG): container finished" podID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerID="6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5" exitCode=0
Jul 28 13:27:28.608606 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.608613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" event={"ID":"6412e209-40c0-4d1c-8e97-c8519c5034b1","Type":"ContainerDied","Data":"6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5"}
Jul 28 13:27:28.608859 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.608624    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"
Jul 28 13:27:28.608859 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.608655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8" event={"ID":"6412e209-40c0-4d1c-8e97-c8519c5034b1","Type":"ContainerDied","Data":"50591545187a38b72b25f27701cbcf5c9d8457fd43fa904d67de08f2e2f37dcf"}
Jul 28 13:27:28.608859 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.608678    2565 scope.go:117] "RemoveContainer" containerID="6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5"
Jul 28 13:27:28.619967 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.619944    2565 scope.go:117] "RemoveContainer" containerID="4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d"
Jul 28 13:27:28.629898 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.629875    2565 scope.go:117] "RemoveContainer" containerID="6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5"
Jul 28 13:27:28.630231 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.630208    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"]
Jul 28 13:27:28.630300 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:27:28.630253    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5\": container with ID starting with 6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5 not found: ID does not exist" containerID="6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5"
Jul 28 13:27:28.630300 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.630281    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5"} err="failed to get container status \"6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5\": rpc error: code = NotFound desc = could not find container \"6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5\": container with ID starting with 6ed8fe0d4edae44664c56acc02ec3bbd974b204192b871f984c2ad50574888e5 not found: ID does not exist"
Jul 28 13:27:28.630380 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.630302    2565 scope.go:117] "RemoveContainer" containerID="4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d"
Jul 28 13:27:28.630583 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:27:28.630561    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d\": container with ID starting with 4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d not found: ID does not exist" containerID="4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d"
Jul 28 13:27:28.630647 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.630593    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d"} err="failed to get container status \"4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d\": rpc error: code = NotFound desc = could not find container \"4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d\": container with ID starting with 4ea0331f4818d706fe0b4064eec11c006d9cb3bc34cda7c8cc81375376504b5d not found: ID does not exist"
Jul 28 13:27:28.636146 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:28.636117    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-8fb56b-openshift-default-5d6c88fcc6-f76q8"]
Jul 28 13:27:29.900648 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:29.900607    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" path="/var/lib/kubelet/pods/6412e209-40c0-4d1c-8e97-c8519c5034b1/volumes"
Jul 28 13:27:33.474279 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.474230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:33.501683 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.501648    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"]
Jul 28 13:27:33.501934 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.501907    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k" podUID="a83f8b6e-e815-4939-a339-738b38487733" containerName="payload-processing" containerID="cri-o://17e072d5272a634bf732bb115ff84ae914746faf85aeeeb3a341d4f3ccff4451" gracePeriod=30
Jul 28 13:27:33.509069 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.509033    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"]
Jul 28 13:27:33.509405 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.509367    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4" podUID="5ca5f2b7-2f99-4265-849a-5ea1c9432306" containerName="payload-pre-processing" containerID="cri-o://bdd419c07e400daa762e3c337f54a4064f32bccb15aa91f96a62f57647721143" gracePeriod=30
Jul 28 13:27:33.550402 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.550366    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:33.639510 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.639479    2565 generic.go:356] "Generic (PLEG): container finished" podID="5ca5f2b7-2f99-4265-849a-5ea1c9432306" containerID="bdd419c07e400daa762e3c337f54a4064f32bccb15aa91f96a62f57647721143" exitCode=0
Jul 28 13:27:33.639703 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.639548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4" event={"ID":"5ca5f2b7-2f99-4265-849a-5ea1c9432306","Type":"ContainerDied","Data":"bdd419c07e400daa762e3c337f54a4064f32bccb15aa91f96a62f57647721143"}
Jul 28 13:27:33.641268 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.641231    2565 generic.go:356] "Generic (PLEG): container finished" podID="a83f8b6e-e815-4939-a339-738b38487733" containerID="17e072d5272a634bf732bb115ff84ae914746faf85aeeeb3a341d4f3ccff4451" exitCode=0
Jul 28 13:27:33.641424 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.641292    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k" event={"ID":"a83f8b6e-e815-4939-a339-738b38487733","Type":"ContainerDied","Data":"17e072d5272a634bf732bb115ff84ae914746faf85aeeeb3a341d4f3ccff4451"}
Jul 28 13:27:33.652674 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.652643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:33.810830 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.810805    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:27:33.814093 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.814061    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:27:33.829347 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.829313    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a83f8b6e-e815-4939-a339-738b38487733-plugins-config-volume\") pod \"a83f8b6e-e815-4939-a339-738b38487733\" (UID: \"a83f8b6e-e815-4939-a339-738b38487733\") "
Jul 28 13:27:33.829635 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.829367    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb5fk\" (UniqueName: \"kubernetes.io/projected/a83f8b6e-e815-4939-a339-738b38487733-kube-api-access-wb5fk\") pod \"a83f8b6e-e815-4939-a339-738b38487733\" (UID: \"a83f8b6e-e815-4939-a339-738b38487733\") "
Jul 28 13:27:33.829635 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.829450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkf87\" (UniqueName: \"kubernetes.io/projected/5ca5f2b7-2f99-4265-849a-5ea1c9432306-kube-api-access-lkf87\") pod \"5ca5f2b7-2f99-4265-849a-5ea1c9432306\" (UID: \"5ca5f2b7-2f99-4265-849a-5ea1c9432306\") "
Jul 28 13:27:33.829635 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.829493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ca5f2b7-2f99-4265-849a-5ea1c9432306-plugins-config-volume\") pod \"5ca5f2b7-2f99-4265-849a-5ea1c9432306\" (UID: \"5ca5f2b7-2f99-4265-849a-5ea1c9432306\") "
Jul 28 13:27:33.829935 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.829763    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a83f8b6e-e815-4939-a339-738b38487733-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a83f8b6e-e815-4939-a339-738b38487733" (UID: "a83f8b6e-e815-4939-a339-738b38487733"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:27:33.830187 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.830159    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ca5f2b7-2f99-4265-849a-5ea1c9432306-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ca5f2b7-2f99-4265-849a-5ea1c9432306" (UID: "5ca5f2b7-2f99-4265-849a-5ea1c9432306"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:27:33.831951 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.831927    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a83f8b6e-e815-4939-a339-738b38487733-kube-api-access-wb5fk" (OuterVolumeSpecName: "kube-api-access-wb5fk") pod "a83f8b6e-e815-4939-a339-738b38487733" (UID: "a83f8b6e-e815-4939-a339-738b38487733"). InnerVolumeSpecName "kube-api-access-wb5fk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:27:33.832097 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.831959    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ca5f2b7-2f99-4265-849a-5ea1c9432306-kube-api-access-lkf87" (OuterVolumeSpecName: "kube-api-access-lkf87") pod "5ca5f2b7-2f99-4265-849a-5ea1c9432306" (UID: "5ca5f2b7-2f99-4265-849a-5ea1c9432306"). InnerVolumeSpecName "kube-api-access-lkf87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:27:33.931204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.931166    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkf87\" (UniqueName: \"kubernetes.io/projected/5ca5f2b7-2f99-4265-849a-5ea1c9432306-kube-api-access-lkf87\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:33.931204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.931195    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ca5f2b7-2f99-4265-849a-5ea1c9432306-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:33.931204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.931205    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a83f8b6e-e815-4939-a339-738b38487733-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:33.931204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:33.931213    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb5fk\" (UniqueName: \"kubernetes.io/projected/a83f8b6e-e815-4939-a339-738b38487733-kube-api-access-wb5fk\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:34.648346 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:34.648320    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"
Jul 28 13:27:34.648818 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:34.648364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4" event={"ID":"5ca5f2b7-2f99-4265-849a-5ea1c9432306","Type":"ContainerDied","Data":"125246c93b9d1f0cc92a753ce40daac39791a0fc340cc8eeeee4f3ca5e650194"}
Jul 28 13:27:34.648818 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:34.648428    2565 scope.go:117] "RemoveContainer" containerID="bdd419c07e400daa762e3c337f54a4064f32bccb15aa91f96a62f57647721143"
Jul 28 13:27:34.649877 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:34.649853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k" event={"ID":"a83f8b6e-e815-4939-a339-738b38487733","Type":"ContainerDied","Data":"5e66d414e006e44ae6d49f298b522a14b8a8e9fce12868b131c40ba89d01ecb4"}
Jul 28 13:27:34.649958 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:34.649867    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"
Jul 28 13:27:34.658103 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:34.658083    2565 scope.go:117] "RemoveContainer" containerID="17e072d5272a634bf732bb115ff84ae914746faf85aeeeb3a341d4f3ccff4451"
Jul 28 13:27:34.666338 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:34.666304    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"]
Jul 28 13:27:34.672945 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:34.672914    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-06a4d2-7754b8d6dd-rl9h4"]
Jul 28 13:27:34.681842 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:34.681806    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"]
Jul 28 13:27:34.687901 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:34.687869    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-06a4d2-58f98f774-5cv9k"]
Jul 28 13:27:35.899817 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:35.899785    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ca5f2b7-2f99-4265-849a-5ea1c9432306" path="/var/lib/kubelet/pods/5ca5f2b7-2f99-4265-849a-5ea1c9432306/volumes"
Jul 28 13:27:35.900248 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:35.900204    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a83f8b6e-e815-4939-a339-738b38487733" path="/var/lib/kubelet/pods/a83f8b6e-e815-4939-a339-738b38487733/volumes"
Jul 28 13:27:38.077081 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:38.077044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:38.523420 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:38.523382    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:45.286273 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:45.286246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:45.388817 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:45.388780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:45.708108 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:45.708068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:45.923947 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:45.923909    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:56.666742 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:56.666704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:56.696738 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:56.696698    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"]
Jul 28 13:27:56.697062 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:56.697006    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n" podUID="af0256d6-7825-4c81-b78f-1c3f9e374e88" containerName="payload-processing" containerID="cri-o://b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273" gracePeriod=30
Jul 28 13:27:56.703661 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:56.703622    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"]
Jul 28 13:27:56.704176 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:56.704144    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr" podUID="d68e03e1-dba2-429d-822a-08bc56640805" containerName="payload-pre-processing" containerID="cri-o://ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066" gracePeriod=30
Jul 28 13:27:56.741612 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:56.741574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:56.841021 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:56.840958    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:56.960889 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:56.960848    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:27:56.997815 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:56.997790    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:27:57.064934 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.064903    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af0256d6-7825-4c81-b78f-1c3f9e374e88-plugins-config-volume\") pod \"af0256d6-7825-4c81-b78f-1c3f9e374e88\" (UID: \"af0256d6-7825-4c81-b78f-1c3f9e374e88\") "
Jul 28 13:27:57.065182 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.065010    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6glpg\" (UniqueName: \"kubernetes.io/projected/d68e03e1-dba2-429d-822a-08bc56640805-kube-api-access-6glpg\") pod \"d68e03e1-dba2-429d-822a-08bc56640805\" (UID: \"d68e03e1-dba2-429d-822a-08bc56640805\") "
Jul 28 13:27:57.065182 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.065070    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj6f4\" (UniqueName: \"kubernetes.io/projected/af0256d6-7825-4c81-b78f-1c3f9e374e88-kube-api-access-bj6f4\") pod \"af0256d6-7825-4c81-b78f-1c3f9e374e88\" (UID: \"af0256d6-7825-4c81-b78f-1c3f9e374e88\") "
Jul 28 13:27:57.065182 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.065115    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d68e03e1-dba2-429d-822a-08bc56640805-plugins-config-volume\") pod \"d68e03e1-dba2-429d-822a-08bc56640805\" (UID: \"d68e03e1-dba2-429d-822a-08bc56640805\") "
Jul 28 13:27:57.065524 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.065489    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68e03e1-dba2-429d-822a-08bc56640805-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d68e03e1-dba2-429d-822a-08bc56640805" (UID: "d68e03e1-dba2-429d-822a-08bc56640805"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:27:57.065832 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.065811    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0256d6-7825-4c81-b78f-1c3f9e374e88-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af0256d6-7825-4c81-b78f-1c3f9e374e88" (UID: "af0256d6-7825-4c81-b78f-1c3f9e374e88"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:27:57.067421 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.067399    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68e03e1-dba2-429d-822a-08bc56640805-kube-api-access-6glpg" (OuterVolumeSpecName: "kube-api-access-6glpg") pod "d68e03e1-dba2-429d-822a-08bc56640805" (UID: "d68e03e1-dba2-429d-822a-08bc56640805"). InnerVolumeSpecName "kube-api-access-6glpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:27:57.067582 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.067562    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0256d6-7825-4c81-b78f-1c3f9e374e88-kube-api-access-bj6f4" (OuterVolumeSpecName: "kube-api-access-bj6f4") pod "af0256d6-7825-4c81-b78f-1c3f9e374e88" (UID: "af0256d6-7825-4c81-b78f-1c3f9e374e88"). InnerVolumeSpecName "kube-api-access-bj6f4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:27:57.166606 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.166541    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af0256d6-7825-4c81-b78f-1c3f9e374e88-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:57.166606 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.166583    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6glpg\" (UniqueName: \"kubernetes.io/projected/d68e03e1-dba2-429d-822a-08bc56640805-kube-api-access-6glpg\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:57.166606 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.166598    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj6f4\" (UniqueName: \"kubernetes.io/projected/af0256d6-7825-4c81-b78f-1c3f9e374e88-kube-api-access-bj6f4\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:57.166606 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.166610    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d68e03e1-dba2-429d-822a-08bc56640805-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:27:57.775119 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.775082    2565 generic.go:356] "Generic (PLEG): container finished" podID="af0256d6-7825-4c81-b78f-1c3f9e374e88" containerID="b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273" exitCode=0
Jul 28 13:27:57.775579 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.775134    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"
Jul 28 13:27:57.775579 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.775170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n" event={"ID":"af0256d6-7825-4c81-b78f-1c3f9e374e88","Type":"ContainerDied","Data":"b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273"}
Jul 28 13:27:57.775579 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.775229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n" event={"ID":"af0256d6-7825-4c81-b78f-1c3f9e374e88","Type":"ContainerDied","Data":"f09656da4873d2ff657afd483a7ff50ee1afd8ca1583addd238ad3b8bc3b583d"}
Jul 28 13:27:57.775579 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.775258    2565 scope.go:117] "RemoveContainer" containerID="b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273"
Jul 28 13:27:57.776660 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.776458    2565 generic.go:356] "Generic (PLEG): container finished" podID="d68e03e1-dba2-429d-822a-08bc56640805" containerID="ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066" exitCode=0
Jul 28 13:27:57.776660 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.776499    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"
Jul 28 13:27:57.776660 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.776509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr" event={"ID":"d68e03e1-dba2-429d-822a-08bc56640805","Type":"ContainerDied","Data":"ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066"}
Jul 28 13:27:57.776660 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.776555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr" event={"ID":"d68e03e1-dba2-429d-822a-08bc56640805","Type":"ContainerDied","Data":"5e7789b33130b6b081e5b888bcd5c7c5341946fdf3eaf7e4534c7c851107b301"}
Jul 28 13:27:57.785250 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.785227    2565 scope.go:117] "RemoveContainer" containerID="b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273"
Jul 28 13:27:57.785625 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:27:57.785594    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273\": container with ID starting with b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273 not found: ID does not exist" containerID="b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273"
Jul 28 13:27:57.785711 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.785639    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273"} err="failed to get container status \"b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273\": rpc error: code = NotFound desc = could not find container \"b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273\": container with ID starting with b312e91ef4de398e76321956d08159ecfd5b0c8ab1c1afe19ed56856a23f1273 not found: ID does not exist"
Jul 28 13:27:57.785711 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.785663    2565 scope.go:117] "RemoveContainer" containerID="ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066"
Jul 28 13:27:57.796902 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.796869    2565 scope.go:117] "RemoveContainer" containerID="ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066"
Jul 28 13:27:57.797591 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:27:57.797566    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066\": container with ID starting with ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066 not found: ID does not exist" containerID="ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066"
Jul 28 13:27:57.797686 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.797598    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066"} err="failed to get container status \"ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066\": rpc error: code = NotFound desc = could not find container \"ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066\": container with ID starting with ab51bf7e18a8352c725b07f6902b8905f2a51a0d381cceb5b5a5895c89c52066 not found: ID does not exist"
Jul 28 13:27:57.799157 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.799135    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"]
Jul 28 13:27:57.804794 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.804766    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-67d68f-6c5985cdf8-nkm7n"]
Jul 28 13:27:57.814267 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.814233    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"]
Jul 28 13:27:57.818081 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.818054    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-67d68f-767cb57748-8bmxr"]
Jul 28 13:27:57.900756 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.900722    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0256d6-7825-4c81-b78f-1c3f9e374e88" path="/var/lib/kubelet/pods/af0256d6-7825-4c81-b78f-1c3f9e374e88/volumes"
Jul 28 13:27:57.901122 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:27:57.901109    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68e03e1-dba2-429d-822a-08bc56640805" path="/var/lib/kubelet/pods/d68e03e1-dba2-429d-822a-08bc56640805/volumes"
Jul 28 13:28:01.136834 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:01.136798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:01.614285 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:01.614253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:07.495047 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:07.495012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:07.595147 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:07.595104    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:07.787795 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:07.787706    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"]
Jul 28 13:28:07.787970 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:07.787935    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy" containerID="cri-o://b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db" gracePeriod=30
Jul 28 13:28:07.816165 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:07.816134    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:08.080741 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:08.080653    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:13.047006 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.046917    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:28:13.114124 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114090    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-podinfo\") pod \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") "
Jul 28 13:28:13.114310 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114141    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-credential-socket\") pod \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") "
Jul 28 13:28:13.114310 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114159    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-envoy\") pod \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") "
Jul 28 13:28:13.114310 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114179    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-certs\") pod \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") "
Jul 28 13:28:13.114310 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114219    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-socket\") pod \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") "
Jul 28 13:28:13.114310 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114239    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-token\") pod \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") "
Jul 28 13:28:13.114668 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114311    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfrgh\" (UniqueName: \"kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-kube-api-access-vfrgh\") pod \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") "
Jul 28 13:28:13.114668 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114337    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-data\") pod \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") "
Jul 28 13:28:13.114668 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istiod-ca-cert\") pod \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\" (UID: \"1e9cab7c-fdf5-407d-bcfd-241fe7513a91\") "
Jul 28 13:28:13.114668 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114477    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e9cab7c-fdf5-407d-bcfd-241fe7513a91" (UID: "1e9cab7c-fdf5-407d-bcfd-241fe7513a91"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:28:13.114668 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e9cab7c-fdf5-407d-bcfd-241fe7513a91" (UID: "1e9cab7c-fdf5-407d-bcfd-241fe7513a91"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:28:13.114935 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114772    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:13.114935 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114792    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:13.114935 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114824    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e9cab7c-fdf5-407d-bcfd-241fe7513a91" (UID: "1e9cab7c-fdf5-407d-bcfd-241fe7513a91"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:28:13.114935 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.114855    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e9cab7c-fdf5-407d-bcfd-241fe7513a91" (UID: "1e9cab7c-fdf5-407d-bcfd-241fe7513a91"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:28:13.115601 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.115578    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e9cab7c-fdf5-407d-bcfd-241fe7513a91" (UID: "1e9cab7c-fdf5-407d-bcfd-241fe7513a91"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:28:13.116778 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.116745    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-kube-api-access-vfrgh" (OuterVolumeSpecName: "kube-api-access-vfrgh") pod "1e9cab7c-fdf5-407d-bcfd-241fe7513a91" (UID: "1e9cab7c-fdf5-407d-bcfd-241fe7513a91"). InnerVolumeSpecName "kube-api-access-vfrgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:28:13.116778 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.116745    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e9cab7c-fdf5-407d-bcfd-241fe7513a91" (UID: "1e9cab7c-fdf5-407d-bcfd-241fe7513a91"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:28:13.116940 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.116917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e9cab7c-fdf5-407d-bcfd-241fe7513a91" (UID: "1e9cab7c-fdf5-407d-bcfd-241fe7513a91"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:28:13.117089 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.117069    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e9cab7c-fdf5-407d-bcfd-241fe7513a91" (UID: "1e9cab7c-fdf5-407d-bcfd-241fe7513a91"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:28:13.215334 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.215292    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:13.215334 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.215325    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:13.215334 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.215334    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:13.215583 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.215353    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:13.215583 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.215362    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfrgh\" (UniqueName: \"kubernetes.io/projected/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-kube-api-access-vfrgh\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:13.215583 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.215372    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:13.215583 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.215380    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e9cab7c-fdf5-407d-bcfd-241fe7513a91-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:13.862499 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.862461    2565 generic.go:356] "Generic (PLEG): container finished" podID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerID="b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db" exitCode=0
Jul 28 13:28:13.862694 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.862515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" event={"ID":"1e9cab7c-fdf5-407d-bcfd-241fe7513a91","Type":"ContainerDied","Data":"b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db"}
Jul 28 13:28:13.862694 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.862537    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"
Jul 28 13:28:13.862694 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.862587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm" event={"ID":"1e9cab7c-fdf5-407d-bcfd-241fe7513a91","Type":"ContainerDied","Data":"d65878d201a5ba8220bfdd073f8f14acc02ed24a350dd04e423b9b9b15a82908"}
Jul 28 13:28:13.862694 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.862611    2565 scope.go:117] "RemoveContainer" containerID="b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db"
Jul 28 13:28:13.872860 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.872838    2565 scope.go:117] "RemoveContainer" containerID="e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f"
Jul 28 13:28:13.882902 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.882879    2565 scope.go:117] "RemoveContainer" containerID="b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db"
Jul 28 13:28:13.883402 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:28:13.883371    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db\": container with ID starting with b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db not found: ID does not exist" containerID="b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db"
Jul 28 13:28:13.883652 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.883415    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db"} err="failed to get container status \"b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db\": rpc error: code = NotFound desc = could not find container \"b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db\": container with ID starting with b56f719a3146b122aa1ce88e665c2b40492081f30c3329f60768d118b5fc90db not found: ID does not exist"
Jul 28 13:28:13.883652 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.883442    2565 scope.go:117] "RemoveContainer" containerID="e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f"
Jul 28 13:28:13.883836 ip-10-0-128-176 kubenswrapper[2565]: E0728 13:28:13.883815    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f\": container with ID starting with e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f not found: ID does not exist" containerID="e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f"
Jul 28 13:28:13.883894 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.883844    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f"} err="failed to get container status \"e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f\": rpc error: code = NotFound desc = could not find container \"e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f\": container with ID starting with e734539f31951eb07398388d97e3503a6a6f94b7203cd8fab46291e3374bef7f not found: ID does not exist"
Jul 28 13:28:13.885694 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.885674    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"]
Jul 28 13:28:13.891585 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.891560    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-67d68f-openshift-default-5d5f6747b-hbmdm"]
Jul 28 13:28:13.900224 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:13.900188    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" path="/var/lib/kubelet/pods/1e9cab7c-fdf5-407d-bcfd-241fe7513a91/volumes"
Jul 28 13:28:16.105377 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:16.105345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:18.633319 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.633273    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"]
Jul 28 13:28:18.633874 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.633519    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb" podUID="7ba4f71b-8e12-46ef-9c96-c83e24a3bee7" containerName="payload-pre-processing" containerID="cri-o://edf042747fb4da7dc185672e633a6892335d0a1447e3b0a9f6120499a84e97e6" gracePeriod=30
Jul 28 13:28:18.656174 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.656117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:18.893169 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.893133    2565 generic.go:356] "Generic (PLEG): container finished" podID="7ba4f71b-8e12-46ef-9c96-c83e24a3bee7" containerID="edf042747fb4da7dc185672e633a6892335d0a1447e3b0a9f6120499a84e97e6" exitCode=0
Jul 28 13:28:18.893349 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.893203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb" event={"ID":"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7","Type":"ContainerDied","Data":"edf042747fb4da7dc185672e633a6892335d0a1447e3b0a9f6120499a84e97e6"}
Jul 28 13:28:18.893349 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.893285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb" event={"ID":"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7","Type":"ContainerDied","Data":"833b4157ee500869b3365815daa29d57d204444cf19847ed8dc9e7fc986d2a70"}
Jul 28 13:28:18.893349 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.893302    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="833b4157ee500869b3365815daa29d57d204444cf19847ed8dc9e7fc986d2a70"
Jul 28 13:28:18.904817 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.904793    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:28:18.970450 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.970412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx8g9\" (UniqueName: \"kubernetes.io/projected/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-kube-api-access-rx8g9\") pod \"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7\" (UID: \"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7\") "
Jul 28 13:28:18.970677 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.970467    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-plugins-config-volume\") pod \"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7\" (UID: \"7ba4f71b-8e12-46ef-9c96-c83e24a3bee7\") "
Jul 28 13:28:18.970859 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.970836    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7ba4f71b-8e12-46ef-9c96-c83e24a3bee7" (UID: "7ba4f71b-8e12-46ef-9c96-c83e24a3bee7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:28:18.972747 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:18.972724    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-kube-api-access-rx8g9" (OuterVolumeSpecName: "kube-api-access-rx8g9") pod "7ba4f71b-8e12-46ef-9c96-c83e24a3bee7" (UID: "7ba4f71b-8e12-46ef-9c96-c83e24a3bee7"). InnerVolumeSpecName "kube-api-access-rx8g9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:28:19.071387 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:19.071351    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx8g9\" (UniqueName: \"kubernetes.io/projected/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-kube-api-access-rx8g9\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:19.071387 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:19.071385    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7-plugins-config-volume\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:19.897941 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:19.897898    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"
Jul 28 13:28:19.921024 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:19.920972    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"]
Jul 28 13:28:19.923801 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:19.923768    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-827464-85fdf748dd-8z6hb"]
Jul 28 13:28:20.491810 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:20.491766    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:21.899841 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:21.899806    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba4f71b-8e12-46ef-9c96-c83e24a3bee7" path="/var/lib/kubelet/pods/7ba4f71b-8e12-46ef-9c96-c83e24a3bee7/volumes"
Jul 28 13:28:23.300910 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:23.300871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:23.710238 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:23.710199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:29.504747 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:29.504711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:29.575825 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:29.575796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:29.797377 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:29.797285    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"]
Jul 28 13:28:29.797599 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:29.797567    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy" containerID="cri-o://95d10f48e0b4d8a4de8a95011fc99600a3532548065ab40e4a2ca501fd4aac23" gracePeriod=30
Jul 28 13:28:29.819461 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:29.819427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:30.066307 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:30.066219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:34.975726 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:34.975692    2565 generic.go:356] "Generic (PLEG): container finished" podID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerID="95d10f48e0b4d8a4de8a95011fc99600a3532548065ab40e4a2ca501fd4aac23" exitCode=0
Jul 28 13:28:34.976188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:34.975756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" event={"ID":"d99b0ee0-6774-40ab-ba82-606e14aa8138","Type":"ContainerDied","Data":"95d10f48e0b4d8a4de8a95011fc99600a3532548065ab40e4a2ca501fd4aac23"}
Jul 28 13:28:34.976188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:34.975831    2565 scope.go:117] "RemoveContainer" containerID="4734bd8de44e2969bf03bb48c2b0a04c889ade660506db36778543e513808d4a"
Jul 28 13:28:35.062449 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.062359    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:28:35.124339 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124299    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-envoy\") pod \"d99b0ee0-6774-40ab-ba82-606e14aa8138\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") "
Jul 28 13:28:35.124543 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124386    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d99b0ee0-6774-40ab-ba82-606e14aa8138-istiod-ca-cert\") pod \"d99b0ee0-6774-40ab-ba82-606e14aa8138\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") "
Jul 28 13:28:35.124543 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124416    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-certs\") pod \"d99b0ee0-6774-40ab-ba82-606e14aa8138\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") "
Jul 28 13:28:35.124543 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124450    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-data\") pod \"d99b0ee0-6774-40ab-ba82-606e14aa8138\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") "
Jul 28 13:28:35.124543 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124471    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-socket\") pod \"d99b0ee0-6774-40ab-ba82-606e14aa8138\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") "
Jul 28 13:28:35.124543 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124514    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-token\") pod \"d99b0ee0-6774-40ab-ba82-606e14aa8138\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") "
Jul 28 13:28:35.124543 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124543    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-podinfo\") pod \"d99b0ee0-6774-40ab-ba82-606e14aa8138\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") "
Jul 28 13:28:35.124873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124584    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2v9w\" (UniqueName: \"kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-kube-api-access-h2v9w\") pod \"d99b0ee0-6774-40ab-ba82-606e14aa8138\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") "
Jul 28 13:28:35.124873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124634    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-credential-socket\") pod \"d99b0ee0-6774-40ab-ba82-606e14aa8138\" (UID: \"d99b0ee0-6774-40ab-ba82-606e14aa8138\") "
Jul 28 13:28:35.124873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124841    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d99b0ee0-6774-40ab-ba82-606e14aa8138" (UID: "d99b0ee0-6774-40ab-ba82-606e14aa8138"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:28:35.124873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.124858    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d99b0ee0-6774-40ab-ba82-606e14aa8138-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d99b0ee0-6774-40ab-ba82-606e14aa8138" (UID: "d99b0ee0-6774-40ab-ba82-606e14aa8138"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:28:35.125157 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.125017    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d99b0ee0-6774-40ab-ba82-606e14aa8138-istiod-ca-cert\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:35.125157 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.125123    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:35.125157 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.125098    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d99b0ee0-6774-40ab-ba82-606e14aa8138" (UID: "d99b0ee0-6774-40ab-ba82-606e14aa8138"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:28:35.125458 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.125432    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d99b0ee0-6774-40ab-ba82-606e14aa8138" (UID: "d99b0ee0-6774-40ab-ba82-606e14aa8138"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:28:35.125619 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.125584    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-data" (OuterVolumeSpecName: "istio-data") pod "d99b0ee0-6774-40ab-ba82-606e14aa8138" (UID: "d99b0ee0-6774-40ab-ba82-606e14aa8138"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:28:35.126953 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.126923    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d99b0ee0-6774-40ab-ba82-606e14aa8138" (UID: "d99b0ee0-6774-40ab-ba82-606e14aa8138"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:28:35.127095 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.126954    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d99b0ee0-6774-40ab-ba82-606e14aa8138" (UID: "d99b0ee0-6774-40ab-ba82-606e14aa8138"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:28:35.127095 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.127030    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-token" (OuterVolumeSpecName: "istio-token") pod "d99b0ee0-6774-40ab-ba82-606e14aa8138" (UID: "d99b0ee0-6774-40ab-ba82-606e14aa8138"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:28:35.127095 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.127077    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-kube-api-access-h2v9w" (OuterVolumeSpecName: "kube-api-access-h2v9w") pod "d99b0ee0-6774-40ab-ba82-606e14aa8138" (UID: "d99b0ee0-6774-40ab-ba82-606e14aa8138"). InnerVolumeSpecName "kube-api-access-h2v9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:28:35.225999 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.225953    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-token\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:35.226188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.226047    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-podinfo\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:35.226188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.226063    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2v9w\" (UniqueName: \"kubernetes.io/projected/d99b0ee0-6774-40ab-ba82-606e14aa8138-kube-api-access-h2v9w\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:35.226188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.226074    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-credential-socket\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:35.226188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.226083    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-envoy\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:35.226188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.226092    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-workload-certs\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:35.226188 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.226099    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d99b0ee0-6774-40ab-ba82-606e14aa8138-istio-data\") on node \"ip-10-0-128-176.ec2.internal\" DevicePath \"\""
Jul 28 13:28:35.982647 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.982610    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"
Jul 28 13:28:35.983161 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.982647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m" event={"ID":"d99b0ee0-6774-40ab-ba82-606e14aa8138","Type":"ContainerDied","Data":"4226f116cc29b97af5a9c36bc0b43891c74d5abb1a12833a278970635f741fc3"}
Jul 28 13:28:35.983161 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.982707    2565 scope.go:117] "RemoveContainer" containerID="95d10f48e0b4d8a4de8a95011fc99600a3532548065ab40e4a2ca501fd4aac23"
Jul 28 13:28:35.998565 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:35.998530    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"]
Jul 28 13:28:36.005079 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:36.005051    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-827464-openshift-default-7cff7744f6-5qn4m"]
Jul 28 13:28:37.803477 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:37.803447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7974886bdb-rmcj9_b6c9a01c-8005-4863-b481-5266f246fd7f/manager/0.log"
Jul 28 13:28:37.810307 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:37.810281    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7974886bdb-rmcj9_b6c9a01c-8005-4863-b481-5266f246fd7f/copy-manifests/0.log"
Jul 28 13:28:37.900368 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:37.900332    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" path="/var/lib/kubelet/pods/d99b0ee0-6774-40ab-ba82-606e14aa8138/volumes"
Jul 28 13:28:38.484826 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:38.484799    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754060-d4rfn_d5a32e11-278c-4eff-b114-519987cc9caf/cleanup/0.log"
Jul 28 13:28:40.465203 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:40.465161    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5mkql_2bd04226-dae0-417c-95d7-6fba0c7245c5/manager/0.log"
Jul 28 13:28:40.590370 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:40.590339    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ljswh_a922736c-5875-49f4-985d-b5e71f6f4bef/kuadrant-console-plugin/0.log"
Jul 28 13:28:42.051514 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:42.051482    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b958f484-zlwkm_f1c28984-3d42-4204-b47d-1b594597704a/kube-auth-proxy/0.log"
Jul 28 13:28:42.487537 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:42.487497    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8vw2x_f83412d3-3120-4c48-9ce2-ab14ed74a60e/payload-processing/0.log"
Jul 28 13:28:42.627425 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:42.627386    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b5489f54f-lfkkv_fbb8f4a1-6686-49ee-9e82-88cf65d64996/router/0.log"
Jul 28 13:28:43.162578 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:43.162535    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-slnpf_1784fc39-5cee-41d6-bab4-cef13020f1bc/main/0.log"
Jul 28 13:28:43.435780 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:43.435699    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjnxj9_f0409bc5-adf9-4643-a5c6-861a4fce1929/main/0.log"
Jul 28 13:28:43.711803 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:43.711767    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-cbcfj_50be309f-4f36-4962-b6ee-a036f22caa40/main/0.log"
Jul 28 13:28:50.428567 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.428521    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5hhgv/must-gather-8vq2w"]
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.428933    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c7c9288-7c03-4062-8f09-80bd00eb18fd" containerName="payload-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.428948    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c7c9288-7c03-4062-8f09-80bd00eb18fd" containerName="payload-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.428960    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.428966    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429018    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429026    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429032    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b26970f6-315c-4d51-a803-8461d752a04e" containerName="payload-pre-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429038    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b26970f6-315c-4d51-a803-8461d752a04e" containerName="payload-pre-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429048    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429053    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429062    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ca5f2b7-2f99-4265-849a-5ea1c9432306" containerName="payload-pre-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429067    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ca5f2b7-2f99-4265-849a-5ea1c9432306" containerName="payload-pre-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429077    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba13166e-568b-459b-9ce4-2d5b857c9926" containerName="payload-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429082    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba13166e-568b-459b-9ce4-2d5b857c9926" containerName="payload-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429090    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a83f8b6e-e815-4939-a339-738b38487733" containerName="payload-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429095    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a83f8b6e-e815-4939-a339-738b38487733" containerName="payload-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429103    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0256d6-7825-4c81-b78f-1c3f9e374e88" containerName="payload-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429108    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0256d6-7825-4c81-b78f-1c3f9e374e88" containerName="payload-processing"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429114    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429120    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy"
Jul 28 13:28:50.429116 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429128    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429133    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429141    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba4f71b-8e12-46ef-9c96-c83e24a3bee7" containerName="payload-pre-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429146    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba4f71b-8e12-46ef-9c96-c83e24a3bee7" containerName="payload-pre-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429153    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68e03e1-dba2-429d-822a-08bc56640805" containerName="payload-pre-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429157    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68e03e1-dba2-429d-822a-08bc56640805" containerName="payload-pre-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429219    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68e03e1-dba2-429d-822a-08bc56640805" containerName="payload-pre-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429226    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429233    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429238    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0256d6-7825-4c81-b78f-1c3f9e374e88" containerName="payload-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429244    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429251    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e9cab7c-fdf5-407d-bcfd-241fe7513a91" containerName="istio-proxy"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429256    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6412e209-40c0-4d1c-8e97-c8519c5034b1" containerName="istio-proxy"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429261    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba4f71b-8e12-46ef-9c96-c83e24a3bee7" containerName="payload-pre-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429266    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba13166e-568b-459b-9ce4-2d5b857c9926" containerName="payload-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429271    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c7c9288-7c03-4062-8f09-80bd00eb18fd" containerName="payload-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429276    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b26970f6-315c-4d51-a803-8461d752a04e" containerName="payload-pre-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429281    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ca5f2b7-2f99-4265-849a-5ea1c9432306" containerName="payload-pre-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429287    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a83f8b6e-e815-4939-a339-738b38487733" containerName="payload-processing"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429364    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429371    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy"
Jul 28 13:28:50.429862 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.429432    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99b0ee0-6774-40ab-ba82-606e14aa8138" containerName="istio-proxy"
Jul 28 13:28:50.433744 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.433726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5hhgv/must-gather-8vq2w"
Jul 28 13:28:50.436878 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.436857    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5hhgv\"/\"kube-root-ca.crt\""
Jul 28 13:28:50.437182 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.437163    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5hhgv\"/\"openshift-service-ca.crt\""
Jul 28 13:28:50.443877 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.443851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5hhgv/must-gather-8vq2w"]
Jul 28 13:28:50.557771 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.557739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:50.574773 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.574736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4v64\" (UniqueName: \"kubernetes.io/projected/5a914726-9dc6-4b48-8b5d-8c5f7aade4ca-kube-api-access-f4v64\") pod \"must-gather-8vq2w\" (UID: \"5a914726-9dc6-4b48-8b5d-8c5f7aade4ca\") " pod="openshift-must-gather-5hhgv/must-gather-8vq2w"
Jul 28 13:28:50.574951 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.574857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5a914726-9dc6-4b48-8b5d-8c5f7aade4ca-must-gather-output\") pod \"must-gather-8vq2w\" (UID: \"5a914726-9dc6-4b48-8b5d-8c5f7aade4ca\") " pod="openshift-must-gather-5hhgv/must-gather-8vq2w"
Jul 28 13:28:50.676294 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.676258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5a914726-9dc6-4b48-8b5d-8c5f7aade4ca-must-gather-output\") pod \"must-gather-8vq2w\" (UID: \"5a914726-9dc6-4b48-8b5d-8c5f7aade4ca\") " pod="openshift-must-gather-5hhgv/must-gather-8vq2w"
Jul 28 13:28:50.676486 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.676320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4v64\" (UniqueName: \"kubernetes.io/projected/5a914726-9dc6-4b48-8b5d-8c5f7aade4ca-kube-api-access-f4v64\") pod \"must-gather-8vq2w\" (UID: \"5a914726-9dc6-4b48-8b5d-8c5f7aade4ca\") " pod="openshift-must-gather-5hhgv/must-gather-8vq2w"
Jul 28 13:28:50.676630 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.676606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5a914726-9dc6-4b48-8b5d-8c5f7aade4ca-must-gather-output\") pod \"must-gather-8vq2w\" (UID: \"5a914726-9dc6-4b48-8b5d-8c5f7aade4ca\") " pod="openshift-must-gather-5hhgv/must-gather-8vq2w"
Jul 28 13:28:50.678371 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.678345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:50.691842 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.691763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4v64\" (UniqueName: \"kubernetes.io/projected/5a914726-9dc6-4b48-8b5d-8c5f7aade4ca-kube-api-access-f4v64\") pod \"must-gather-8vq2w\" (UID: \"5a914726-9dc6-4b48-8b5d-8c5f7aade4ca\") " pod="openshift-must-gather-5hhgv/must-gather-8vq2w"
Jul 28 13:28:50.744605 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.744562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5hhgv/must-gather-8vq2w"
Jul 28 13:28:50.891932 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.891902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5hhgv/must-gather-8vq2w"]
Jul 28 13:28:50.894406 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:28:50.894373    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a914726_9dc6_4b48_8b5d_8c5f7aade4ca.slice/crio-9af19a5e064940728cdb77fb3d5b78b6dc87180bdbd5a3b156b596f8bb23797a WatchSource:0}: Error finding container 9af19a5e064940728cdb77fb3d5b78b6dc87180bdbd5a3b156b596f8bb23797a: Status 404 returned error can't find the container with id 9af19a5e064940728cdb77fb3d5b78b6dc87180bdbd5a3b156b596f8bb23797a
Jul 28 13:28:50.896284 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:50.896265    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:28:51.058883 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:51.058846    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5hhgv/must-gather-8vq2w" event={"ID":"5a914726-9dc6-4b48-8b5d-8c5f7aade4ca","Type":"ContainerStarted","Data":"9af19a5e064940728cdb77fb3d5b78b6dc87180bdbd5a3b156b596f8bb23797a"}
Jul 28 13:28:52.069650 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:52.069604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5hhgv/must-gather-8vq2w" event={"ID":"5a914726-9dc6-4b48-8b5d-8c5f7aade4ca","Type":"ContainerStarted","Data":"64aee68cd3e033505e08049f6ac822d3f7501dd06cecb3f14906744fdf2898e1"}
Jul 28 13:28:52.070204 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:52.069670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5hhgv/must-gather-8vq2w" event={"ID":"5a914726-9dc6-4b48-8b5d-8c5f7aade4ca","Type":"ContainerStarted","Data":"dfcc3fe92493f61c9b5e874b00ec3ca88eb55bf4645849690a139655505d38e7"}
Jul 28 13:28:52.087230 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:52.087170    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5hhgv/must-gather-8vq2w" podStartSLOduration=1.335493622 podStartE2EDuration="2.087147546s" totalImagesPullingTime="751.653924ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:28:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:28:52.085306029 +0000 UTC m=+3540.695171740" watchObservedRunningTime="2026-07-28 13:28:52.087147546 +0000 UTC m=+3540.697013256"
Jul 28 13:28:52.373278 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:52.373084    2565 scope.go:117] "RemoveContainer" containerID="edf042747fb4da7dc185672e633a6892335d0a1447e3b0a9f6120499a84e97e6"
Jul 28 13:28:53.416507 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:53.416470    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tdmcg_7f58d468-064d-4ed1-8ff9-df98f7c7a9d5/global-pull-secret-syncer/0.log"
Jul 28 13:28:53.468871 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:53.468833    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k4l99_736215d4-1e7e-422b-b6df-0ccb207e10e7/konnectivity-agent/0.log"
Jul 28 13:28:53.584082 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:53.584045    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-176.ec2.internal_2ce9148be59f873fc772478b9a59c1fc/haproxy/0.log"
Jul 28 13:28:59.775044 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:59.775008    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5mkql_2bd04226-dae0-417c-95d7-6fba0c7245c5/manager/0.log"
Jul 28 13:28:59.808494 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:28:59.808458    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ljswh_a922736c-5875-49f4-985d-b5e71f6f4bef/kuadrant-console-plugin/0.log"
Jul 28 13:29:02.294089 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.294054    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7ddb6c5c65-hnk92_41b478d2-e9a9-42ce-8c83-c8de1649e4c1/metrics-server/0.log"
Jul 28 13:29:02.569424 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.569316    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgkfv_944d0e7f-2605-4e55-89af-ef93adf5de79/node-exporter/0.log"
Jul 28 13:29:02.610838 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.610793    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgkfv_944d0e7f-2605-4e55-89af-ef93adf5de79/kube-rbac-proxy/0.log"
Jul 28 13:29:02.640525 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.640494    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dgkfv_944d0e7f-2605-4e55-89af-ef93adf5de79/init-textfile/0.log"
Jul 28 13:29:02.752039 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.752009    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f526e66-8392-4a2d-bb17-768199401633/prometheus/0.log"
Jul 28 13:29:02.776575 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.776543    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f526e66-8392-4a2d-bb17-768199401633/config-reloader/0.log"
Jul 28 13:29:02.802498 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.802465    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f526e66-8392-4a2d-bb17-768199401633/thanos-sidecar/0.log"
Jul 28 13:29:02.826223 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.826108    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f526e66-8392-4a2d-bb17-768199401633/kube-rbac-proxy-web/0.log"
Jul 28 13:29:02.850999 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.850941    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f526e66-8392-4a2d-bb17-768199401633/kube-rbac-proxy/0.log"
Jul 28 13:29:02.876361 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.876336    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f526e66-8392-4a2d-bb17-768199401633/kube-rbac-proxy-thanos/0.log"
Jul 28 13:29:02.900651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.900609    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f526e66-8392-4a2d-bb17-768199401633/init-config-reloader/0.log"
Jul 28 13:29:02.931951 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.931907    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-tx6h6_eae8a0dc-1624-4782-b1b4-44e8cb634c56/prometheus-operator/0.log"
Jul 28 13:29:02.951611 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:02.951582    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-tx6h6_eae8a0dc-1624-4782-b1b4-44e8cb634c56/kube-rbac-proxy/0.log"
Jul 28 13:29:03.930965 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:03.930922    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"]
Jul 28 13:29:03.935751 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:03.935715    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:03.937688 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:03.937655    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5hhgv\"/\"default-dockercfg-tmkdf\""
Jul 28 13:29:03.942778 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:03.942738    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"]
Jul 28 13:29:04.021647 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.021610    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-proc\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.022089 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.022063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f2v4\" (UniqueName: \"kubernetes.io/projected/db94ac4f-ec62-494c-861c-a7e5cf32418a-kube-api-access-8f2v4\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.022308 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.022290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-podres\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.022492 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.022478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-sys\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.022651 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.022627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-lib-modules\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.123557 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.123513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2v4\" (UniqueName: \"kubernetes.io/projected/db94ac4f-ec62-494c-861c-a7e5cf32418a-kube-api-access-8f2v4\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.123765 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.123583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-podres\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.123765 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.123632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-sys\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.123765 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.123661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-lib-modules\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.123765 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.123704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-proc\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.124060 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.123807    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-proc\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.124326 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.124301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-podres\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.124402 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.124375    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-sys\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.124482 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.124463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db94ac4f-ec62-494c-861c-a7e5cf32418a-lib-modules\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.132044 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.132005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f2v4\" (UniqueName: \"kubernetes.io/projected/db94ac4f-ec62-494c-861c-a7e5cf32418a-kube-api-access-8f2v4\") pod \"perf-node-gather-daemonset-v2ctr\" (UID: \"db94ac4f-ec62-494c-861c-a7e5cf32418a\") " pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.252807 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.252770    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:04.414343 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.414318    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-6bldm_9da533a3-e5e5-424a-bc79-7746d876a327/networking-console-plugin/0.log"
Jul 28 13:29:04.445142 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.443902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"]
Jul 28 13:29:04.449867 ip-10-0-128-176 kubenswrapper[2565]: W0728 13:29:04.449834    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb94ac4f_ec62_494c_861c_a7e5cf32418a.slice/crio-d480574ac45b4738033174342a96bad9958a0281e22ab2510d6d51c2939f06a7 WatchSource:0}: Error finding container d480574ac45b4738033174342a96bad9958a0281e22ab2510d6d51c2939f06a7: Status 404 returned error can't find the container with id d480574ac45b4738033174342a96bad9958a0281e22ab2510d6d51c2939f06a7
Jul 28 13:29:04.966847 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.966822    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/1.log"
Jul 28 13:29:04.974819 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:04.974788    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-8d6cg_3e07272f-da7a-4f83-8feb-3721e38d02f6/console-operator/2.log"
Jul 28 13:29:05.166537 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:05.166499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr" event={"ID":"db94ac4f-ec62-494c-861c-a7e5cf32418a","Type":"ContainerStarted","Data":"cbcdc1086de6dcfd5904aeafa59e9bc6d01696f7ed7455ebe9f91ff9f50452f2"}
Jul 28 13:29:05.166720 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:05.166563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr" event={"ID":"db94ac4f-ec62-494c-861c-a7e5cf32418a","Type":"ContainerStarted","Data":"d480574ac45b4738033174342a96bad9958a0281e22ab2510d6d51c2939f06a7"}
Jul 28 13:29:05.166720 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:05.166679    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:05.181970 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:05.181901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr" podStartSLOduration=2.181879255 podStartE2EDuration="2.181879255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:29:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:29:05.180620322 +0000 UTC m=+3553.790486030" watchObservedRunningTime="2026-07-28 13:29:05.181879255 +0000 UTC m=+3553.791744963"
Jul 28 13:29:05.475788 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:05.475756    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-tdd9f_a9295418-b56a-4559-82cd-1bc2e54c47e7/download-server/0.log"
Jul 28 13:29:06.068612 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:06.068579    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-58s4v_a96582bc-6f32-4b60-a9d4-eeb3f5bedac2/volume-data-source-validator/0.log"
Jul 28 13:29:07.276791 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:07.276759    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w9z87_6bd4e8d2-1e75-4009-8aad-b916a0bb6266/dns/0.log"
Jul 28 13:29:07.299389 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:07.299365    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w9z87_6bd4e8d2-1e75-4009-8aad-b916a0bb6266/kube-rbac-proxy/0.log"
Jul 28 13:29:07.378724 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:07.378696    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wgj9h_c6622717-f1dd-4632-8535-16a44cceb950/dns-node-resolver/0.log"
Jul 28 13:29:07.983430 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:07.983399    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b8f4r_e4f78aa3-8acd-41e7-8cc4-2e33c3938634/node-ca/0.log"
Jul 28 13:29:09.322699 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:09.322666    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b958f484-zlwkm_f1c28984-3d42-4204-b47d-1b594597704a/kube-auth-proxy/0.log"
Jul 28 13:29:09.483873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:09.483837    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8vw2x_f83412d3-3120-4c48-9ce2-ab14ed74a60e/payload-processing/0.log"
Jul 28 13:29:09.510104 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:09.510079    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b5489f54f-lfkkv_fbb8f4a1-6686-49ee-9e82-88cf65d64996/router/0.log"
Jul 28 13:29:10.395347 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:10.395315    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlfr9_4fbdc23a-ddae-4e43-a918-6386d294be86/serve-healthcheck-canary/0.log"
Jul 28 13:29:10.875519 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:10.875445    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-2vpn2_ce291cde-2d3b-4c5f-8246-814881b8c891/insights-operator/0.log"
Jul 28 13:29:10.878368 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:10.878316    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-2vpn2_ce291cde-2d3b-4c5f-8246-814881b8c891/insights-operator/1.log"
Jul 28 13:29:11.044464 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:11.044432    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl55j_c06f0b0d-03a0-4f54-bd8b-31db467ce298/kube-rbac-proxy/0.log"
Jul 28 13:29:11.068077 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:11.068037    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl55j_c06f0b0d-03a0-4f54-bd8b-31db467ce298/exporter/0.log"
Jul 28 13:29:11.090433 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:11.090403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pl55j_c06f0b0d-03a0-4f54-bd8b-31db467ce298/extractor/0.log"
Jul 28 13:29:11.189853 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:11.189758    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5hhgv/perf-node-gather-daemonset-v2ctr"
Jul 28 13:29:14.531566 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:14.531477    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7974886bdb-rmcj9_b6c9a01c-8005-4863-b481-5266f246fd7f/manager/0.log"
Jul 28 13:29:14.552873 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:14.552849    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7974886bdb-rmcj9_b6c9a01c-8005-4863-b481-5266f246fd7f/copy-manifests/0.log"
Jul 28 13:29:15.666887 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:15.666847    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b958f484-zlwkm_f1c28984-3d42-4204-b47d-1b594597704a/kube-auth-proxy/0.log"
Jul 28 13:29:15.794630 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:15.794596    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8vw2x_f83412d3-3120-4c48-9ce2-ab14ed74a60e/payload-processing/0.log"
Jul 28 13:29:15.812908 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:15.812882    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b5489f54f-lfkkv_fbb8f4a1-6686-49ee-9e82-88cf65d64996/router/0.log"
Jul 28 13:29:15.924897 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:15.924811    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-746578bc67-jsj2w_144ec6c9-2f78-4e91-920d-b63b1d04076b/manager/0.log"
Jul 28 13:29:17.512072 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:17.512040    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b958f484-zlwkm_f1c28984-3d42-4204-b47d-1b594597704a/kube-auth-proxy/0.log"
Jul 28 13:29:17.645935 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:17.645901    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8vw2x_f83412d3-3120-4c48-9ce2-ab14ed74a60e/payload-processing/0.log"
Jul 28 13:29:17.660140 ip-10-0-128-176 kubenswrapper[2565]: I0728 13:29:17.660107    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b5489f54f-lfkkv_fbb8f4a1-6686-49ee-9e82-88cf65d64996/router/0.log"