Jul 28 12:51:12.965216 ip-10-0-133-173 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 12:51:13.314524 ip-10-0-133-173 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 12:51:13.314524 ip-10-0-133-173 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 12:51:13.314524 ip-10-0-133-173 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 12:51:13.314524 ip-10-0-133-173 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 12:51:13.314524 ip-10-0-133-173 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 12:51:13.316681 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.316568    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 12:51:13.322282 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322261    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:13.322282 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322282    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322286    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322289    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322293    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322303    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322306    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322309    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322312    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322315    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322318    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322321    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322323    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322326    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322329    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322333    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322336    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322338    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322342    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322344    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322347    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:13.322356 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322350    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322353    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322355    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322358    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322361    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322364    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322367    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322370    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322372    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322376    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322380    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322383    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322385    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322388    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322391    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322393    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322396    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322398    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322401    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:13.322835 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322403    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322406    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322409    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322412    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322414    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322417    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322419    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322423    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322427    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322429    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322432    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322435    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322438    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322440    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322443    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322446    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322449    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322451    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322454    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322457    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:13.323316 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322459    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322463    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322467    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322470    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322474    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322477    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322480    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322482    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322485    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322487    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322490    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322493    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322495    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322497    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322500    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322503    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322509    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322512    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322516    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:13.323800 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322520    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322523    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322526    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322529    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322532    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322535    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322538    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322540    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322544    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322547    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322550    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322553    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322556    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322559    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322562    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322564    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322567    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322570    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322573    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:13.324271 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.322576    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323333    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323341    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323344    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323348    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323351    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323353    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323356    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323359    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323363    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323365    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323368    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323372    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323377    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323380    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323383    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323386    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323388    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323391    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323393    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:13.324722 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323396    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323398    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323401    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323404    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323406    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323409    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323411    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323414    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323417    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323419    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323422    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323424    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323428    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323431    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323433    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323436    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323438    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323441    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323443    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323446    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:13.325217 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323451    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323455    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323458    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323461    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323464    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323467    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323470    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323473    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323476    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323479    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323482    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323485    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323487    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323490    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323492    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323496    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323498    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323501    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323503    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:13.325706 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323506    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323508    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323511    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323513    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323516    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323519    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323522    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323525    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323527    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323530    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323532    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323535    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323538    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323540    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323543    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323546    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323548    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323551    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323554    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323557    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:13.326177 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323559    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323562    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323564    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323568    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323571    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323575    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323578    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323582    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323585    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323587    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323590    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323592    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323594    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323597    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323600    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323602    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323605    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323608    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323611    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:13.326664 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323614    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.323616    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324576    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324583    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324586    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324589    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324591    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324597    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324599    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324602    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324605    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324608    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324611    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324614    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324616    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324619    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324622    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324624    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324627    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324629    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:13.327133 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324632    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324634    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324637    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324640    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324642    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324645    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324647    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324650    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324653    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324655    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324658    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324661    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324665    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324668    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324670    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324673    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324676    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324678    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324681    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324686    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:13.327638 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324689    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324691    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324694    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324696    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324700    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324703    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324705    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324708    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324711    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324713    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324716    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324718    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324721    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324724    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324727    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324730    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324733    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324735    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324738    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324741    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:13.328153 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324743    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324746    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324749    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324751    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324754    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324759    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324762    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324766    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324769    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324772    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324774    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324777    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324780    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324782    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324785    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324789    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324793    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324796    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324799    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:13.328648 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324802    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324804    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324807    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324810    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324813    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324815    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324818    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324820    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324824    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324827    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324830    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324832    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324835    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324837    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324840    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324843    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324846    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324848    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324851    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324854    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:13.329150 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324856    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.324859    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.324971    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.324987    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.324994    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.324999    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325004    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325007    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325011    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325015    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325019    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325022    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325025    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325028    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325032    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325035    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325038    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325042    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325045    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325047    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325052    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325055    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325058    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325061    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 12:51:13.329630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325064    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325068    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325071    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325075    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325078    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325081    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325084    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325087    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325091    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325095    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325099    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325102    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325106    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325109    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325112    2567 flags.go:64] FLAG: --enable-server="true"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325115    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325120    2567 flags.go:64] FLAG: --event-burst="100"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325123    2567 flags.go:64] FLAG: --event-qps="50"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325126    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325129    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325132    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325136    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325139    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325142    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325145    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 28 12:51:13.330222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325148    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325151    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325154    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325157    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325160    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325163    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325165    2567 flags.go:64] FLAG: --feature-gates=""
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325169    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325172    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325177    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325180    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325183    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325186    2567 flags.go:64] FLAG: --help="false"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325189    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325192    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325195    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325198    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325202    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325206    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325209    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325212    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325214    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325218    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 12:51:13.330857 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325221    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325225    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325228    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325231    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325234    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325237    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325240    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325242    2567 flags.go:64] FLAG: --lock-file=""
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325245    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325248    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325251    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325256    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325259    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325262    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325265    2567 flags.go:64] FLAG: --logging-format="text"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325268    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325272    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325275    2567 flags.go:64] FLAG: --manifest-url=""
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325279    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325283    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325286    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325291    2567 flags.go:64] FLAG: --max-pods="110"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325294    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325297    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325300    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 12:51:13.331464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325303    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325307    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325310    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325313    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325320    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325323    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325326    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325329    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325332    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325338    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325340    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325343    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325347    2567 flags.go:64] FLAG: --port="10250"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325350    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325353    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-048c95b3ccd94d071"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325356    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325360    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325363    2567 flags.go:64] FLAG: --register-node="true"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325366    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325370    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325373    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325376    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325379    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325382    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325387    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 12:51:13.332130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325390    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325393    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325396    2567 flags.go:64] FLAG: --runonce="false"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325399    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325402    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325405    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325408    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325411    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325414    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325418    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325421    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325424    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325427    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325430    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325433    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325436    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325439    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325442    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325447    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325450    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325453    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325457    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325460    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325463    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325466    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 12:51:13.332747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325468    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325471    2567 flags.go:64] FLAG: --v="2"
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325475    2567 flags.go:64] FLAG: --version="false"
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325479    2567 flags.go:64] FLAG: --vmodule=""
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325483    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.325486    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325610    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325614    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325616    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325619    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325622    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325624    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325627    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325629    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325633    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325635    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325638    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325641    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325644    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325647    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325649    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:13.333394 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325652    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325655    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325657    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325660    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325663    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325665    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325668    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325671    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325674    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325676    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325679    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325681    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325684    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325686    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325689    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325692    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325694    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325700    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325702    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325706    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:13.333971 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325711    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325715    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325718    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325721    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325724    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325727    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325729    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325732    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325735    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325739    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325742    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325745    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325748    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325750    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325753    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325756    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325758    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325761    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325764    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325767    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:13.334554 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325769    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325772    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325775    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325777    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325780    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325784    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325788    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325791    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325794    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325798    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325801    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325804    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325807    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325810    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325813    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325815    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325818    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325821    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325824    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:13.335295 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325826    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325829    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325832    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325835    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325838    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325840    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325843    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325846    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325849    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325851    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325854    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325856    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325859    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325862    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325864    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325867    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325869    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325872    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325874    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325877    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:13.335806 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325880    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325882    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325886    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325889    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.325891    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.326966    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.335764    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.335784    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.335809    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.335818    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335903    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335910    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335932    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335937    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:13.336313 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335943    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335948    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335952    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335957    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335961    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335966    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335973    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335979    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335983    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335986    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335990    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335993    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335996    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.335999    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336002    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336005    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336007    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336010    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336012    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336015    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:13.336655 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336018    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336021    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336024    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336027    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336029    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336034    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336038    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336042    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336046    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336050    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336055    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336058    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336060    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336063    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336066    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336069    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336071    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336074    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336077    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:13.337149 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336080    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336082    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336085    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336089    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336091    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336094    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336097    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336100    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336102    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336105    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336108    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336110    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336113    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336116    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336118    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336121    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336124    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336126    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336129    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336132    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:13.337612 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336135    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336138    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336141    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336143    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336146    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336149    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336151    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336154    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336156    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336159    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336162    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336165    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336170    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336174    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336178    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336180    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336184    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336187    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336192    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336195    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:13.338120 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336198    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336201    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336204    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336208    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336211    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336214    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336216    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336219    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336222    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336224    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336227    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336230    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336232    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336235    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336238    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:13.338615 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336240    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.336245    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336366    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336370    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336374    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336376    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336379    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336382    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336385    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336387    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336390    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336392    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336395    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336397    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336400    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 12:51:13.339072 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336403    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336405    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336408    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336411    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336413    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336415    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336418    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336420    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336423    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336426    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336428    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336431    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336434    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336436    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336439    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336442    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336445    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336447    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336450    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336453    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 12:51:13.339472 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336455    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336458    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336460    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336463    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336466    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336468    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336471    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336473    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336477    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336481    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336484    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336487    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336490    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336493    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336496    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336499    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336502    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336505    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336508    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336511    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 12:51:13.339990 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336514    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336517    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336519    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336522    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336525    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336530    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336532    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336535    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336538    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336541    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336543    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336546    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336548    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336551    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336553    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336556    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336558    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336561    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336563    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 12:51:13.340466 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336566    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336568    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336571    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336573    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336576    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336578    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336582    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336584    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336587    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336589    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336592    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336594    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336597    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336599    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336602    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336604    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336607    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336610    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336613    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336615    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 12:51:13.340913 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336618    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336620    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336623    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336625    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336628    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336630    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:13.336634    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.336639    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.336756    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.339575    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.340882    2567 server.go:1019] "Starting client certificate rotation"
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.340950    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 12:51:13.341400 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.340989    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 12:51:13.343436 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.343421    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 12:51:13.344643 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.344624    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 12:51:13.353962 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.353942    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 28 12:51:13.357145 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.357127    2567 log.go:25] "Validated CRI v1 image API"
Jul 28 12:51:13.358041 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.358026    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 12:51:13.360311 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.360286    2567 fs.go:135] Filesystem UUIDs: map[6b5a97d3-a5c7-4189-9596-71392ed61125:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a5b918af-836f-4246-83f1-78b6ec85adeb:/dev/nvme0n1p4]
Jul 28 12:51:13.360391 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.360310    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 12:51:13.366059 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.365935    2567 manager.go:216] Machine: {Timestamp:2026-07-28 12:51:13.364022834 +0000 UTC m=+0.293306742 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102995 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec221cbac2d631410ce2a20178c1ea00 SystemUUID:ec221cba-c2d6-3141-0ce2-a20178c1ea00 BootID:6c452e78-b75c-4f98-94eb-24c80715ff81 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:7e:24:b9:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:7e:24:b9:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:10:e1:ad:4f:b1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 12:51:13.366059 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.366048    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 12:51:13.366236 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.366161    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 12:51:13.368611 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.368581    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 12:51:13.368751 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.368613    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-173.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 12:51:13.369324 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.369313    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 12:51:13.369362 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.369326    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 12:51:13.369362 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.369334    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 12:51:13.370642 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.370623    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 12:51:13.370757 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.370742    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 12:51:13.372098 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.372086    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 12:51:13.376167 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.376156    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 12:51:13.376299 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.376289    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 12:51:13.376331 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.376320    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 12:51:13.376331 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.376329    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 12:51:13.376388 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.376347    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 12:51:13.376388 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.376356    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 28 12:51:13.376388 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.376364    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 12:51:13.378467 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.378440    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 12:51:13.378572 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.378484    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 12:51:13.380942 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.380906    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 12:51:13.382663 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.382491    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 12:51:13.382663 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.382517    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 12:51:13.383173 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383161    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 12:51:13.383204 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383177    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 12:51:13.383204 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383183    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 12:51:13.383204 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383190    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 12:51:13.383204 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383200    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 12:51:13.383301 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383206    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 12:51:13.383301 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383214    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 12:51:13.383301 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383219    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 12:51:13.383301 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383226    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 12:51:13.383301 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383231    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 12:51:13.383301 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383239    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 12:51:13.383301 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383244    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 12:51:13.383926 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383899    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 12:51:13.383926 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.383911    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 12:51:13.386081 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.386048    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 12:51:13.386373 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.386352    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 12:51:13.387045 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.387034    2567 server.go:1268] "Started kubelet"
Jul 28 12:51:13.387514 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.387092    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 12:51:13.387514 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.387114    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 12:51:13.387514 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.387184    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 12:51:13.387763 ip-10-0-133-173 systemd[1]: Started Kubernetes Kubelet.
Jul 28 12:51:13.388428 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.388258    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-173.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 12:51:13.388829 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.388816    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 12:51:13.389112 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.389099    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 12:51:13.392572 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.392555    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 12:51:13.395945 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.395911    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 12:51:13.395945 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.395938    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 12:51:13.396103 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.396018    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found"
Jul 28 12:51:13.396686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.396553    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 12:51:13.396686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.396555    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 12:51:13.396686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.396583    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 12:51:13.396686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.396629    2567 factory.go:55] Registering systemd factory
Jul 28 12:51:13.396686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.396644    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 28 12:51:13.396686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.396666    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 12:51:13.396686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.396677    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 12:51:13.397050 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.396886    2567 factory.go:153] Registering CRI-O factory
Jul 28 12:51:13.397050 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.396897    2567 factory.go:223] Registration of the crio container factory successfully
Jul 28 12:51:13.397050 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.396981    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 12:51:13.397050 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.397006    2567 factory.go:103] Registering Raw factory
Jul 28 12:51:13.397050 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.397020    2567 manager.go:1196] Started watching for new ooms in manager
Jul 28 12:51:13.397470 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.397455    2567 manager.go:349] Starting recovery of all containers
Jul 28 12:51:13.398242 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.397392    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-173.ec2.internal.18c6751ddaf5963d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-173.ec2.internal,UID:ip-10-0-133-173.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-173.ec2.internal,},FirstTimestamp:2026-07-28 12:51:13.387009597 +0000 UTC m=+0.316293502,LastTimestamp:2026-07-28 12:51:13.387009597 +0000 UTC m=+0.316293502,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-173.ec2.internal,}"
Jul 28 12:51:13.399525 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.399499    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jx4vl"
Jul 28 12:51:13.405546 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.405523    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jx4vl"
Jul 28 12:51:13.406986 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.406956    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 12:51:13.407145 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.407120    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-173.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 12:51:13.408709 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.408689    2567 manager.go:354] Recovery completed
Jul 28 12:51:13.409908 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.409884    2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 28 12:51:13.412840 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.412825    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:13.414700 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.414684    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:13.414748 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.414717    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:13.414748 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.414728    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:13.415308 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.415289    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 12:51:13.415308 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.415303    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:13.415308 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.415307    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 12:51:13.415441 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.415324    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 12:51:13.415960 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.415911    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:13.416010 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.415971    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:13.416010 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.415984    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:13.417225 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.417212    2567 policy_none.go:49] "None policy: Start"
Jul 28 12:51:13.417277 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.417229    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 12:51:13.417277 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.417239    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 12:51:13.419026 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.419015    2567 policy_none.go:47] "Start"
Jul 28 12:51:13.463597 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.463578    2567 manager.go:337] "Starting Device Plugin manager"
Jul 28 12:51:13.463713 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.463615    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 12:51:13.463713 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.463628    2567 server.go:87] "Starting device plugin registration server"
Jul 28 12:51:13.463906 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.463893    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 12:51:13.464000 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.463908    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 12:51:13.464000 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.463987    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 12:51:13.464086 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.464062    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 12:51:13.464086 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.464070    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 12:51:13.464538 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.464521    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 12:51:13.464612 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.464571    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-173.ec2.internal\" not found"
Jul 28 12:51:13.493179 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.493145    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 12:51:13.499894 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.494246    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 12:51:13.499894 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.494278    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 12:51:13.499894 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.494304    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 12:51:13.499894 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.494334    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 12:51:13.499894 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.496738    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:13.564942 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.564837    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:13.565891 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.565869    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:13.565976 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.565914    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:13.565976 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.565942    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:13.565976 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.565974    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.574028 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.574013    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.574074 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.574037    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-173.ec2.internal\": node \"ip-10-0-133-173.ec2.internal\" not found"
Jul 28 12:51:13.590563 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.590538    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found"
Jul 28 12:51:13.595218 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.595196    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal"]
Jul 28 12:51:13.595279 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.595260    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:13.596133 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.596119    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:13.596203 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.596147    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:13.596203 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.596157    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:13.598410 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.598396    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:13.598498 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.598483    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.598548 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.598505    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:13.599137 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.599122    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:13.599202 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.599148    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:13.599202 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.599157    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:13.599202 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.599123    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:13.599304 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.599214    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:13.599304 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.599223    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:13.601890 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.601877    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.601955 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.601901    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 12:51:13.602598 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.602586    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 12:51:13.602663 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.602608    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 12:51:13.602663 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.602617    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeHasSufficientPID"
Jul 28 12:51:13.636677 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.636646    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-173.ec2.internal\" not found" node="ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.639983 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.639968    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-173.ec2.internal\" not found" node="ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.691338 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.691309    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found"
Jul 28 12:51:13.698121 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.698093    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/305f5fbdf10083198ddc2b41e9e0dffe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"305f5fbdf10083198ddc2b41e9e0dffe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.698212 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.698129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/305f5fbdf10083198ddc2b41e9e0dffe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"305f5fbdf10083198ddc2b41e9e0dffe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.698212 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.698153    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7aef2ed6ac42d45c959a5cf3a54001f5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-173.ec2.internal\" (UID: \"7aef2ed6ac42d45c959a5cf3a54001f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.791967 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.791935    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found"
Jul 28 12:51:13.799297 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.799272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7aef2ed6ac42d45c959a5cf3a54001f5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-173.ec2.internal\" (UID: \"7aef2ed6ac42d45c959a5cf3a54001f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.799414 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.799312    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/305f5fbdf10083198ddc2b41e9e0dffe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"305f5fbdf10083198ddc2b41e9e0dffe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.799414 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.799332    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/305f5fbdf10083198ddc2b41e9e0dffe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"305f5fbdf10083198ddc2b41e9e0dffe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.799414 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.799351    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7aef2ed6ac42d45c959a5cf3a54001f5-config\") pod \"kube-apiserver-proxy-ip-10-0-133-173.ec2.internal\" (UID: \"7aef2ed6ac42d45c959a5cf3a54001f5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.799414 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.799365    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/305f5fbdf10083198ddc2b41e9e0dffe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"305f5fbdf10083198ddc2b41e9e0dffe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.799414 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.799398    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/305f5fbdf10083198ddc2b41e9e0dffe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal\" (UID: \"305f5fbdf10083198ddc2b41e9e0dffe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.892716 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.892654    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found"
Jul 28 12:51:13.939089 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.939060    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.943241 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:13.943221    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:13.993430 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:13.993399    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found"
Jul 28 12:51:14.093869 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.093818    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found"
Jul 28 12:51:14.194244 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.194171    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-173.ec2.internal\" not found"
Jul 28 12:51:14.202753 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.202729    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:14.277496 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.277464    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:14.296424 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.296402    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:14.307072 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.307040    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 12:51:14.308540 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.308524    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal"
Jul 28 12:51:14.317867 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.317845    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 12:51:14.340992 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.340966    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 12:51:14.341138 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.341123    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 12:51:14.341197 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.341165    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 12:51:14.341238 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.341165    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 12:51:14.377279 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.377245    2567 apiserver.go:52] "Watching apiserver"
Jul 28 12:51:14.391593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.391569    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 12:51:14.392621 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.392600    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-v4cfk","openshift-multus/multus-additional-cni-plugins-9947b","openshift-network-diagnostics/network-check-target-g4qxs","openshift-ovn-kubernetes/ovnkube-node-f6dvd","kube-system/global-pull-secret-syncer-smsrp","kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km","openshift-image-registry/node-ca-9zk5p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal","openshift-multus/multus-pkd5r","openshift-multus/network-metrics-daemon-mnjqz","openshift-network-operator/iptables-alerter-vlz98","kube-system/konnectivity-agent-6pcqf","openshift-cluster-node-tuning-operator/tuned-r6bhj"]
Jul 28 12:51:14.395019 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.394998    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.396080 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.396064    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 12:51:14.397178 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.397160    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:14.397412 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.397340    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 12:51:14.397511 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.397442    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 12:51:14.397658 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.397643    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lfl66\""
Jul 28 12:51:14.397699 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.397678    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 12:51:14.399955 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.399935    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 12:51:14.400062 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.399943    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:14.400062 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.399990    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 12:51:14.400062 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.400016    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:14.400193 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.400119    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b8c65\""
Jul 28 12:51:14.401513 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.401495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-socket-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.401586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.401519    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-etc-selinux\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.401586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.401537    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-sys-fs\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.401586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.401561    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4tsb\" (UniqueName: \"kubernetes.io/projected/04357d24-14c3-434a-b29f-39c2e5350a35-kube-api-access-c4tsb\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.401681 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.401598    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01ebce22-4e32-402d-98a7-351b2b60f3c5-agent-certs\") pod \"konnectivity-agent-6pcqf\" (UID: \"01ebce22-4e32-402d-98a7-351b2b60f3c5\") " pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:14.401681 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.401617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01ebce22-4e32-402d-98a7-351b2b60f3c5-konnectivity-ca\") pod \"konnectivity-agent-6pcqf\" (UID: \"01ebce22-4e32-402d-98a7-351b2b60f3c5\") " pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:14.401681 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.401640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-registration-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.401681 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.401665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-device-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.401819 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.401686    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.402197 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.402182    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.404346 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.404330    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:14.404414 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.404383    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:14.404548 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.404534    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 12:51:14.405136 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.405118    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 12:51:14.405208 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.405157    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 12:51:14.405208 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.405157    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 12:51:14.405306 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.405210    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 12:51:14.405306 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.405270    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 12:51:14.405545 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.405531    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rcmhh\""
Jul 28 12:51:14.406560 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.406546    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.408757 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.408741    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 12:51:14.408850 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.408770    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:51:14.408850 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.408837    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.408990 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.408883    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9m49c\""
Jul 28 12:51:14.411105 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.411084    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 12:51:14.411190 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.411167    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 12:51:14.411253 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.411187    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.411308 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.411251    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 12:46:13 +0000 UTC" deadline="2028-01-28 04:37:00.873976585 +0000 UTC"
Jul 28 12:51:14.411308 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.411293    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13167h45m46.46268718s"
Jul 28 12:51:14.411567 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.411554    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kc55j\""
Jul 28 12:51:14.411617 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.411597    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 12:51:14.411691 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.411681    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 12:51:14.413575 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.413557    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 12:51:14.413722 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.413694    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.414713 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.414053    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jpvcn\""
Jul 28 12:51:14.414713 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.414073    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 12:51:14.416006 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.415988    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 12:51:14.416682 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.416664    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.418956 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.418909    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:14.419043 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.419021    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:14.421400 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.421379    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.423680 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.423661    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 12:51:14.429109 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.429091    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 12:51:14.429905 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.429881    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:51:14.430023 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.429965    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 12:51:14.430694 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.430676    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 12:51:14.431649 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.431629    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9vbtr\""
Jul 28 12:51:14.432240 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.432223    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-48l75\""
Jul 28 12:51:14.448798 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.448742    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 12:51:14.449411 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.449377    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305f5fbdf10083198ddc2b41e9e0dffe.slice/crio-a822dda3e261afdb23df7c6c51581f5387f8eef35cb5335d0f2be265f15227c2 WatchSource:0}: Error finding container a822dda3e261afdb23df7c6c51581f5387f8eef35cb5335d0f2be265f15227c2: Status 404 returned error can't find the container with id a822dda3e261afdb23df7c6c51581f5387f8eef35cb5335d0f2be265f15227c2
Jul 28 12:51:14.449851 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.449759    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2qj7r\""
Jul 28 12:51:14.449851 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.449792    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aef2ed6ac42d45c959a5cf3a54001f5.slice/crio-7e0d99967222515f7d101f3dc2f1e63a8e14fbe5bb849f67d70d2556d8eee3fc WatchSource:0}: Error finding container 7e0d99967222515f7d101f3dc2f1e63a8e14fbe5bb849f67d70d2556d8eee3fc: Status 404 returned error can't find the container with id 7e0d99967222515f7d101f3dc2f1e63a8e14fbe5bb849f67d70d2556d8eee3fc
Jul 28 12:51:14.450005 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.449876    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 12:51:14.450005 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.449874    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 12:51:14.452748 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.452729    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wqxf4"
Jul 28 12:51:14.455866 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.455849    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 12:51:14.469819 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.469798    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wqxf4"
Jul 28 12:51:14.497525 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.497502    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 12:51:14.498412 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.498364    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" event={"ID":"305f5fbdf10083198ddc2b41e9e0dffe","Type":"ContainerStarted","Data":"a822dda3e261afdb23df7c6c51581f5387f8eef35cb5335d0f2be265f15227c2"}
Jul 28 12:51:14.499452 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.499427    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" event={"ID":"7aef2ed6ac42d45c959a5cf3a54001f5","Type":"ContainerStarted","Data":"7e0d99967222515f7d101f3dc2f1e63a8e14fbe5bb849f67d70d2556d8eee3fc"}
Jul 28 12:51:14.501898 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.501875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2fd537ed-9ab5-4d16-bef1-957e19f15907-ovnkube-config\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.502013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.501909    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-lib-modules\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.502013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.501950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/043bbf4c-91ea-4807-a459-dc1352806f89-iptables-alerter-script\") pod \"iptables-alerter-vlz98\" (UID: \"043bbf4c-91ea-4807-a459-dc1352806f89\") " pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.502013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.501977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t5xq\" (UniqueName: \"kubernetes.io/projected/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-kube-api-access-7t5xq\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.502128 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502018    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-cni-bin\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.502128 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502041    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-cni-netd\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.502128 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502063    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5spss\" (UniqueName: \"kubernetes.io/projected/afce1f60-fbcc-4321-8529-0ba85b567453-kube-api-access-5spss\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.502128 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502085    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2139ac10-b3ff-4ba1-8189-0d512d855d30-hosts-file\") pod \"node-resolver-v4cfk\" (UID: \"2139ac10-b3ff-4ba1-8189-0d512d855d30\") " pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.502128 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502107    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-var-lib-cni-bin\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.502321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-var-lib-kubelet\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.502321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502148    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-daemon-config\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.502321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502166    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-run-ovn\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.502321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502194    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-etc-kubernetes\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.502321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502211    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-sys-fs\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.502321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502226    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e112889-b95e-488a-b6f7-4b30b5253836-dbus\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:14.502321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502242    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c974650-56f4-451e-a33c-48277a3ab1b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.502321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502256    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-run-k8s-cni-cncf-io\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.502321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502276    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-sys-fs\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.502321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502293    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-node-log\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502323    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-log-socket\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502351    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8klzb\" (UniqueName: \"kubernetes.io/projected/2fd537ed-9ab5-4d16-bef1-957e19f15907-kube-api-access-8klzb\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502379    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-var-lib-cni-multus\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502410    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01ebce22-4e32-402d-98a7-351b2b60f3c5-konnectivity-ca\") pod \"konnectivity-agent-6pcqf\" (UID: \"01ebce22-4e32-402d-98a7-351b2b60f3c5\") " pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502435    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-device-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502461    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c974650-56f4-451e-a33c-48277a3ab1b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502526    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-device-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502563    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-sysctl-d\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502585    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-run\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-host\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502635    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01ebce22-4e32-402d-98a7-351b2b60f3c5-agent-certs\") pod \"konnectivity-agent-6pcqf\" (UID: \"01ebce22-4e32-402d-98a7-351b2b60f3c5\") " pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502671    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-etc-openvswitch\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.502686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502703    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2fd537ed-9ab5-4d16-bef1-957e19f15907-ovn-node-metrics-cert\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-modprobe-d\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502775    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502798    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4tsb\" (UniqueName: \"kubernetes.io/projected/04357d24-14c3-434a-b29f-39c2e5350a35-kube-api-access-c4tsb\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e112889-b95e-488a-b6f7-4b30b5253836-kubelet-config\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502834    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2t78\" (UniqueName: \"kubernetes.io/projected/5c974650-56f4-451e-a33c-48277a3ab1b9-kube-api-access-r2t78\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502854    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-cni-dir\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502866    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502879    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58zdh\" (UniqueName: \"kubernetes.io/projected/8a9e1925-e5c5-453a-943f-2c472b87cd2a-kube-api-access-58zdh\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-run-openvswitch\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502931    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-kubernetes\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-socket-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.502976    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-socket-dir-parent\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503010    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-run-netns\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503031    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-hostroot\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503040    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 12:51:14.503377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503094    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-socket-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503049    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-run-netns\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01ebce22-4e32-402d-98a7-351b2b60f3c5-konnectivity-ca\") pod \"konnectivity-agent-6pcqf\" (UID: \"01ebce22-4e32-402d-98a7-351b2b60f3c5\") " pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503139    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-run-systemd\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503167    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/afce1f60-fbcc-4321-8529-0ba85b567453-etc-tuned\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2139ac10-b3ff-4ba1-8189-0d512d855d30-tmp-dir\") pod \"node-resolver-v4cfk\" (UID: \"2139ac10-b3ff-4ba1-8189-0d512d855d30\") " pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503245    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-systemd\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503300    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-sys\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503317    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-etc-selinux\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503347    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrww8\" (UniqueName: \"kubernetes.io/projected/043bbf4c-91ea-4807-a459-dc1352806f89-kube-api-access-jrww8\") pod \"iptables-alerter-vlz98\" (UID: \"043bbf4c-91ea-4807-a459-dc1352806f89\") " pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503366    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-os-release\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-conf-dir\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503389    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-etc-selinux\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503412    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503446    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-slash\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.504079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-cnibin\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503491    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-registration-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503506    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjgkp\" (UniqueName: \"kubernetes.io/projected/2139ac10-b3ff-4ba1-8189-0d512d855d30-kube-api-access-zjgkp\") pod \"node-resolver-v4cfk\" (UID: \"2139ac10-b3ff-4ba1-8189-0d512d855d30\") " pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503521    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-cnibin\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503535    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2fd537ed-9ab5-4d16-bef1-957e19f15907-env-overrides\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-sysctl-conf\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503579    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/04357d24-14c3-434a-b29f-39c2e5350a35-registration-dir\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503586    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afce1f60-fbcc-4321-8529-0ba85b567453-tmp\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503631    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/043bbf4c-91ea-4807-a459-dc1352806f89-host-slash\") pod \"iptables-alerter-vlz98\" (UID: \"043bbf4c-91ea-4807-a459-dc1352806f89\") " pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503658    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmtnr\" (UniqueName: \"kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr\") pod \"network-check-target-g4qxs\" (UID: \"a5338cba-14a3-4e40-b1c3-3d9e2586cad7\") " pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503684    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c974650-56f4-451e-a33c-48277a3ab1b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503708    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-run-multus-certs\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503747    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-kubelet\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503771    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-var-lib-kubelet\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503808    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hmm2\" (UniqueName: \"kubernetes.io/projected/e40068e5-fe90-4d0f-bedb-007c67c86f02-kube-api-access-6hmm2\") pod \"node-ca-9zk5p\" (UID: \"e40068e5-fe90-4d0f-bedb-007c67c86f02\") " pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-system-cni-dir\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.504557 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503852    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-sysconfig\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.505038 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-cni-binary-copy\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.505038 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503912    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-systemd-units\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.505038 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503948    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2fd537ed-9ab5-4d16-bef1-957e19f15907-ovnkube-script-lib\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.505038 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e40068e5-fe90-4d0f-bedb-007c67c86f02-host\") pod \"node-ca-9zk5p\" (UID: \"e40068e5-fe90-4d0f-bedb-007c67c86f02\") " pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.505038 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503976    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e40068e5-fe90-4d0f-bedb-007c67c86f02-serviceca\") pod \"node-ca-9zk5p\" (UID: \"e40068e5-fe90-4d0f-bedb-007c67c86f02\") " pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.505038 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.503991    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-system-cni-dir\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.505038 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.504028    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-os-release\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.505038 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.504056    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-var-lib-openvswitch\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.506036 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.506022    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01ebce22-4e32-402d-98a7-351b2b60f3c5-agent-certs\") pod \"konnectivity-agent-6pcqf\" (UID: \"01ebce22-4e32-402d-98a7-351b2b60f3c5\") " pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:14.511408 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.511391    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4tsb\" (UniqueName: \"kubernetes.io/projected/04357d24-14c3-434a-b29f-39c2e5350a35-kube-api-access-c4tsb\") pod \"aws-ebs-csi-driver-node-q55km\" (UID: \"04357d24-14c3-434a-b29f-39c2e5350a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.604806 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e40068e5-fe90-4d0f-bedb-007c67c86f02-host\") pod \"node-ca-9zk5p\" (UID: \"e40068e5-fe90-4d0f-bedb-007c67c86f02\") " pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.604806 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604807    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e40068e5-fe90-4d0f-bedb-007c67c86f02-serviceca\") pod \"node-ca-9zk5p\" (UID: \"e40068e5-fe90-4d0f-bedb-007c67c86f02\") " pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.604806 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604826    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-system-cni-dir\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-os-release\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604860    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-var-lib-openvswitch\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604879    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2fd537ed-9ab5-4d16-bef1-957e19f15907-ovnkube-config\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604877    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e40068e5-fe90-4d0f-bedb-007c67c86f02-host\") pod \"node-ca-9zk5p\" (UID: \"e40068e5-fe90-4d0f-bedb-007c67c86f02\") " pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604913    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-var-lib-openvswitch\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604934    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-system-cni-dir\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-lib-modules\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604981    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-os-release\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.604990    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/043bbf4c-91ea-4807-a459-dc1352806f89-iptables-alerter-script\") pod \"iptables-alerter-vlz98\" (UID: \"043bbf4c-91ea-4807-a459-dc1352806f89\") " pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605018    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t5xq\" (UniqueName: \"kubernetes.io/projected/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-kube-api-access-7t5xq\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-cni-bin\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605070    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-cni-netd\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5spss\" (UniqueName: \"kubernetes.io/projected/afce1f60-fbcc-4321-8529-0ba85b567453-kube-api-access-5spss\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605116    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2139ac10-b3ff-4ba1-8189-0d512d855d30-hosts-file\") pod \"node-resolver-v4cfk\" (UID: \"2139ac10-b3ff-4ba1-8189-0d512d855d30\") " pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.605120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605121    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-lib-modules\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-var-lib-cni-bin\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605151    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-cni-netd\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605178    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-var-lib-cni-bin\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605213    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-cni-bin\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605224    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2139ac10-b3ff-4ba1-8189-0d512d855d30-hosts-file\") pod \"node-resolver-v4cfk\" (UID: \"2139ac10-b3ff-4ba1-8189-0d512d855d30\") " pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605312    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-var-lib-kubelet\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-daemon-config\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605352    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-run-ovn\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-etc-kubernetes\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605408    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-etc-kubernetes\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605423    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e112889-b95e-488a-b6f7-4b30b5253836-dbus\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605426    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-run-ovn\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605420    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e40068e5-fe90-4d0f-bedb-007c67c86f02-serviceca\") pod \"node-ca-9zk5p\" (UID: \"e40068e5-fe90-4d0f-bedb-007c67c86f02\") " pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605449    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c974650-56f4-451e-a33c-48277a3ab1b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605373    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-var-lib-kubelet\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605523    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e112889-b95e-488a-b6f7-4b30b5253836-dbus\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-run-k8s-cni-cncf-io\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.605775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-node-log\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605566    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-run-k8s-cni-cncf-io\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605567    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2fd537ed-9ab5-4d16-bef1-957e19f15907-ovnkube-config\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605578    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-log-socket\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/043bbf4c-91ea-4807-a459-dc1352806f89-iptables-alerter-script\") pod \"iptables-alerter-vlz98\" (UID: \"043bbf4c-91ea-4807-a459-dc1352806f89\") " pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605609    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-node-log\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605622    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-log-socket\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8klzb\" (UniqueName: \"kubernetes.io/projected/2fd537ed-9ab5-4d16-bef1-957e19f15907-kube-api-access-8klzb\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605667    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-var-lib-cni-multus\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605692    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c974650-56f4-451e-a33c-48277a3ab1b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605714    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-var-lib-cni-multus\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605718    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-sysctl-d\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-run\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-host\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605783    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605815    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-sysctl-d\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.606586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605841    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-etc-openvswitch\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605865    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605889    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2fd537ed-9ab5-4d16-bef1-957e19f15907-ovn-node-metrics-cert\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.605893    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605901    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-host\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605911    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-modprobe-d\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605951    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e112889-b95e-488a-b6f7-4b30b5253836-kubelet-config\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.605976    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs podName:8a9e1925-e5c5-453a-943f-2c472b87cd2a nodeName:}" failed. No retries permitted until 2026-07-28 12:51:15.105954716 +0000 UTC m=+2.035238644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs") pod "network-metrics-daemon-mnjqz" (UID: "8a9e1925-e5c5-453a-943f-2c472b87cd2a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605976    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-daemon-config\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-run\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.605992    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e112889-b95e-488a-b6f7-4b30b5253836-kubelet-config\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606001    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c974650-56f4-451e-a33c-48277a3ab1b9-cni-binary-copy\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606004    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2t78\" (UniqueName: \"kubernetes.io/projected/5c974650-56f4-451e-a33c-48277a3ab1b9-kube-api-access-r2t78\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606031    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-cni-dir\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606036    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-etc-openvswitch\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-run-ovn-kubernetes\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606074    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-modprobe-d\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.607383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606074    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58zdh\" (UniqueName: \"kubernetes.io/projected/8a9e1925-e5c5-453a-943f-2c472b87cd2a-kube-api-access-58zdh\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-run-openvswitch\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606140    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-kubernetes\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606123    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-cni-dir\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-socket-dir-parent\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606201    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-run-netns\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-hostroot\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606242    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-kubernetes\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606256    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-run-netns\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606282    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-run-openvswitch\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-run-netns\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-run-systemd\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606298    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606318    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-hostroot\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606324    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-run-netns\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606314    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c974650-56f4-451e-a33c-48277a3ab1b9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606360    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-run-systemd\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606365    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-socket-dir-parent\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.608143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/afce1f60-fbcc-4321-8529-0ba85b567453-etc-tuned\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606487    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2139ac10-b3ff-4ba1-8189-0d512d855d30-tmp-dir\") pod \"node-resolver-v4cfk\" (UID: \"2139ac10-b3ff-4ba1-8189-0d512d855d30\") " pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606513    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606528    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-systemd\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.606589    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.606626    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret podName:8e112889-b95e-488a-b6f7-4b30b5253836 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:15.106614939 +0000 UTC m=+2.035898835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret") pod "global-pull-secret-syncer-smsrp" (UID: "8e112889-b95e-488a-b6f7-4b30b5253836") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606638    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-sys\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606658    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrww8\" (UniqueName: \"kubernetes.io/projected/043bbf4c-91ea-4807-a459-dc1352806f89-kube-api-access-jrww8\") pod \"iptables-alerter-vlz98\" (UID: \"043bbf4c-91ea-4807-a459-dc1352806f89\") " pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606657    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-systemd\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606696    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-sys\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-os-release\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606731    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-conf-dir\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-os-release\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606764    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2139ac10-b3ff-4ba1-8189-0d512d855d30-tmp-dir\") pod \"node-resolver-v4cfk\" (UID: \"2139ac10-b3ff-4ba1-8189-0d512d855d30\") " pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606795    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606805    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-multus-conf-dir\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.608741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606829    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-slash\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-cnibin\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606871    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjgkp\" (UniqueName: \"kubernetes.io/projected/2139ac10-b3ff-4ba1-8189-0d512d855d30-kube-api-access-zjgkp\") pod \"node-resolver-v4cfk\" (UID: \"2139ac10-b3ff-4ba1-8189-0d512d855d30\") " pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606885    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-slash\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606894    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-cnibin\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606906    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c974650-56f4-451e-a33c-48277a3ab1b9-cnibin\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.606953    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-cnibin\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607025    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2fd537ed-9ab5-4d16-bef1-957e19f15907-env-overrides\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607054    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-sysctl-conf\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607113    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afce1f60-fbcc-4321-8529-0ba85b567453-tmp\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/043bbf4c-91ea-4807-a459-dc1352806f89-host-slash\") pod \"iptables-alerter-vlz98\" (UID: \"043bbf4c-91ea-4807-a459-dc1352806f89\") " pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607171    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtnr\" (UniqueName: \"kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr\") pod \"network-check-target-g4qxs\" (UID: \"a5338cba-14a3-4e40-b1c3-3d9e2586cad7\") " pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607194    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-sysctl-conf\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607206    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c974650-56f4-451e-a33c-48277a3ab1b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607235    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-run-multus-certs\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-kubelet\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-var-lib-kubelet\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.609239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hmm2\" (UniqueName: \"kubernetes.io/projected/e40068e5-fe90-4d0f-bedb-007c67c86f02-kube-api-access-6hmm2\") pod \"node-ca-9zk5p\" (UID: \"e40068e5-fe90-4d0f-bedb-007c67c86f02\") " pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607338    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-system-cni-dir\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607362    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-sysconfig\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-cni-binary-copy\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607409    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-systemd-units\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-host-kubelet\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607237    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/043bbf4c-91ea-4807-a459-dc1352806f89-host-slash\") pod \"iptables-alerter-vlz98\" (UID: \"043bbf4c-91ea-4807-a459-dc1352806f89\") " pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2fd537ed-9ab5-4d16-bef1-957e19f15907-ovnkube-script-lib\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607429    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2fd537ed-9ab5-4d16-bef1-957e19f15907-env-overrides\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-host-run-multus-certs\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607487    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-system-cni-dir\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2fd537ed-9ab5-4d16-bef1-957e19f15907-systemd-units\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607619    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-etc-sysconfig\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607663    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afce1f60-fbcc-4321-8529-0ba85b567453-var-lib-kubelet\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607828    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c974650-56f4-451e-a33c-48277a3ab1b9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.607990    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2fd537ed-9ab5-4d16-bef1-957e19f15907-ovnkube-script-lib\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.608063    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-cni-binary-copy\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.608551    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/afce1f60-fbcc-4321-8529-0ba85b567453-etc-tuned\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.609688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.608699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2fd537ed-9ab5-4d16-bef1-957e19f15907-ovn-node-metrics-cert\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.610223 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.609522    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afce1f60-fbcc-4321-8529-0ba85b567453-tmp\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.614287 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.614268    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5spss\" (UniqueName: \"kubernetes.io/projected/afce1f60-fbcc-4321-8529-0ba85b567453-kube-api-access-5spss\") pod \"tuned-r6bhj\" (UID: \"afce1f60-fbcc-4321-8529-0ba85b567453\") " pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.616198 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.616174    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:14.616198 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.616200    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:14.616391 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.616213    2567 projected.go:196] Error preparing data for projected volume kube-api-access-hmtnr for pod openshift-network-diagnostics/network-check-target-g4qxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:14.616391 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:14.616269    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr podName:a5338cba-14a3-4e40-b1c3-3d9e2586cad7 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:15.116254021 +0000 UTC m=+2.045537916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hmtnr" (UniqueName: "kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr") pod "network-check-target-g4qxs" (UID: "a5338cba-14a3-4e40-b1c3-3d9e2586cad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:14.616514 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.616482    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t5xq\" (UniqueName: \"kubernetes.io/projected/e19218bb-f199-410e-b5c0-6bf7e7a7a4e8-kube-api-access-7t5xq\") pod \"multus-pkd5r\" (UID: \"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8\") " pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.618021 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.617984    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2t78\" (UniqueName: \"kubernetes.io/projected/5c974650-56f4-451e-a33c-48277a3ab1b9-kube-api-access-r2t78\") pod \"multus-additional-cni-plugins-9947b\" (UID: \"5c974650-56f4-451e-a33c-48277a3ab1b9\") " pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.618114 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.618051    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjgkp\" (UniqueName: \"kubernetes.io/projected/2139ac10-b3ff-4ba1-8189-0d512d855d30-kube-api-access-zjgkp\") pod \"node-resolver-v4cfk\" (UID: \"2139ac10-b3ff-4ba1-8189-0d512d855d30\") " pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.618236 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.618222    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrww8\" (UniqueName: \"kubernetes.io/projected/043bbf4c-91ea-4807-a459-dc1352806f89-kube-api-access-jrww8\") pod \"iptables-alerter-vlz98\" (UID: \"043bbf4c-91ea-4807-a459-dc1352806f89\") " pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.619832 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.619809    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8klzb\" (UniqueName: \"kubernetes.io/projected/2fd537ed-9ab5-4d16-bef1-957e19f15907-kube-api-access-8klzb\") pod \"ovnkube-node-f6dvd\" (UID: \"2fd537ed-9ab5-4d16-bef1-957e19f15907\") " pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.620400 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.620376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hmm2\" (UniqueName: \"kubernetes.io/projected/e40068e5-fe90-4d0f-bedb-007c67c86f02-kube-api-access-6hmm2\") pod \"node-ca-9zk5p\" (UID: \"e40068e5-fe90-4d0f-bedb-007c67c86f02\") " pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.620477 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.620447    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58zdh\" (UniqueName: \"kubernetes.io/projected/8a9e1925-e5c5-453a-943f-2c472b87cd2a-kube-api-access-58zdh\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:14.722876 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.722790    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km"
Jul 28 12:51:14.728333 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.728313    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:14.733511 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.733469    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04357d24_14c3_434a_b29f_39c2e5350a35.slice/crio-5b8fe383799d8e78b2e8fd5557cb35e0281b5f76aa2187cbc751744b4603948d WatchSource:0}: Error finding container 5b8fe383799d8e78b2e8fd5557cb35e0281b5f76aa2187cbc751744b4603948d: Status 404 returned error can't find the container with id 5b8fe383799d8e78b2e8fd5557cb35e0281b5f76aa2187cbc751744b4603948d
Jul 28 12:51:14.735240 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.735131    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:14.740239 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.740213    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ebce22_4e32_402d_98a7_351b2b60f3c5.slice/crio-c5545bbdacc096124b298e0c328574eab0e67e474e976c6f411d1fae35eb6bca WatchSource:0}: Error finding container c5545bbdacc096124b298e0c328574eab0e67e474e976c6f411d1fae35eb6bca: Status 404 returned error can't find the container with id c5545bbdacc096124b298e0c328574eab0e67e474e976c6f411d1fae35eb6bca
Jul 28 12:51:14.745172 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.745150    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd537ed_9ab5_4d16_bef1_957e19f15907.slice/crio-6d6c521235738640f7d4416f4172f9ed72860344cb8458ca3597a00a5075c42c WatchSource:0}: Error finding container 6d6c521235738640f7d4416f4172f9ed72860344cb8458ca3597a00a5075c42c: Status 404 returned error can't find the container with id 6d6c521235738640f7d4416f4172f9ed72860344cb8458ca3597a00a5075c42c
Jul 28 12:51:14.755525 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.755503    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6bhj"
Jul 28 12:51:14.762311 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.762295    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9zk5p"
Jul 28 12:51:14.764210 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.764185    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafce1f60_fbcc_4321_8529_0ba85b567453.slice/crio-2a6b16440b3f29f392338e1968f44258ee35315ea78985562f0bb156fd3fec0c WatchSource:0}: Error finding container 2a6b16440b3f29f392338e1968f44258ee35315ea78985562f0bb156fd3fec0c: Status 404 returned error can't find the container with id 2a6b16440b3f29f392338e1968f44258ee35315ea78985562f0bb156fd3fec0c
Jul 28 12:51:14.768256 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.768241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v4cfk"
Jul 28 12:51:14.771181 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.771061    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40068e5_fe90_4d0f_bedb_007c67c86f02.slice/crio-13a22b7a8ccd0b3d049642b379f5338b5e1f76afaa87dd14158cb6dfae1d9987 WatchSource:0}: Error finding container 13a22b7a8ccd0b3d049642b379f5338b5e1f76afaa87dd14158cb6dfae1d9987: Status 404 returned error can't find the container with id 13a22b7a8ccd0b3d049642b379f5338b5e1f76afaa87dd14158cb6dfae1d9987
Jul 28 12:51:14.773967 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.773944    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9947b"
Jul 28 12:51:14.776568 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.776546    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2139ac10_b3ff_4ba1_8189_0d512d855d30.slice/crio-f649c3c019e7d9ae1b3c5126cddd3653bdb51726b55b188cfa746462884041a2 WatchSource:0}: Error finding container f649c3c019e7d9ae1b3c5126cddd3653bdb51726b55b188cfa746462884041a2: Status 404 returned error can't find the container with id f649c3c019e7d9ae1b3c5126cddd3653bdb51726b55b188cfa746462884041a2
Jul 28 12:51:14.778869 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.778848    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pkd5r"
Jul 28 12:51:14.782183 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.782162    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c974650_56f4_451e_a33c_48277a3ab1b9.slice/crio-16e604be6cd36a0c79eb073ebee40f609b18c678332450959bfadd79178c42ff WatchSource:0}: Error finding container 16e604be6cd36a0c79eb073ebee40f609b18c678332450959bfadd79178c42ff: Status 404 returned error can't find the container with id 16e604be6cd36a0c79eb073ebee40f609b18c678332450959bfadd79178c42ff
Jul 28 12:51:14.784182 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.784163    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vlz98"
Jul 28 12:51:14.787301 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.787279    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19218bb_f199_410e_b5c0_6bf7e7a7a4e8.slice/crio-66a01807d472437f21752c78f104be3535a3b83b88725a5c325b08029b47ea52 WatchSource:0}: Error finding container 66a01807d472437f21752c78f104be3535a3b83b88725a5c325b08029b47ea52: Status 404 returned error can't find the container with id 66a01807d472437f21752c78f104be3535a3b83b88725a5c325b08029b47ea52
Jul 28 12:51:14.794152 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:14.794128    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043bbf4c_91ea_4807_a459_dc1352806f89.slice/crio-2909a54a6ca8861729b4a08f88c1f45d3c7146c8e5f0af4026d9a0cf9f3e7ed5 WatchSource:0}: Error finding container 2909a54a6ca8861729b4a08f88c1f45d3c7146c8e5f0af4026d9a0cf9f3e7ed5: Status 404 returned error can't find the container with id 2909a54a6ca8861729b4a08f88c1f45d3c7146c8e5f0af4026d9a0cf9f3e7ed5
Jul 28 12:51:14.894658 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:14.894474    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:15.110457 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.109983    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:15.110457 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.110031    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:15.110457 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:15.110174    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:15.110457 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:15.110231    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret podName:8e112889-b95e-488a-b6f7-4b30b5253836 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:16.110212999 +0000 UTC m=+3.039496899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret") pod "global-pull-secret-syncer-smsrp" (UID: "8e112889-b95e-488a-b6f7-4b30b5253836") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:15.110777 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:15.110620    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:15.110777 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:15.110673    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs podName:8a9e1925-e5c5-453a-943f-2c472b87cd2a nodeName:}" failed. No retries permitted until 2026-07-28 12:51:16.110657092 +0000 UTC m=+3.039941003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs") pod "network-metrics-daemon-mnjqz" (UID: "8a9e1925-e5c5-453a-943f-2c472b87cd2a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:15.210689 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.210649    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtnr\" (UniqueName: \"kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr\") pod \"network-check-target-g4qxs\" (UID: \"a5338cba-14a3-4e40-b1c3-3d9e2586cad7\") " pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:15.210885 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:15.210873    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:15.211030 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:15.210896    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:15.211030 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:15.210909    2567 projected.go:196] Error preparing data for projected volume kube-api-access-hmtnr for pod openshift-network-diagnostics/network-check-target-g4qxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:15.211030 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:15.210988    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr podName:a5338cba-14a3-4e40-b1c3-3d9e2586cad7 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:16.210968998 +0000 UTC m=+3.140252911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmtnr" (UniqueName: "kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr") pod "network-check-target-g4qxs" (UID: "a5338cba-14a3-4e40-b1c3-3d9e2586cad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:15.475051 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.474861    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:46:14 +0000 UTC" deadline="2028-04-14 12:16:53.810390528 +0000 UTC"
Jul 28 12:51:15.475051 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.474935    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15023h25m38.335460009s"
Jul 28 12:51:15.497586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.497553    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:15.497753 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:15.497694    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:15.543042 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.543005    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v4cfk" event={"ID":"2139ac10-b3ff-4ba1-8189-0d512d855d30","Type":"ContainerStarted","Data":"f649c3c019e7d9ae1b3c5126cddd3653bdb51726b55b188cfa746462884041a2"}
Jul 28 12:51:15.566679 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.566603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9zk5p" event={"ID":"e40068e5-fe90-4d0f-bedb-007c67c86f02","Type":"ContainerStarted","Data":"13a22b7a8ccd0b3d049642b379f5338b5e1f76afaa87dd14158cb6dfae1d9987"}
Jul 28 12:51:15.587600 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.587443    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" event={"ID":"2fd537ed-9ab5-4d16-bef1-957e19f15907","Type":"ContainerStarted","Data":"6d6c521235738640f7d4416f4172f9ed72860344cb8458ca3597a00a5075c42c"}
Jul 28 12:51:15.596431 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.596392    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6pcqf" event={"ID":"01ebce22-4e32-402d-98a7-351b2b60f3c5","Type":"ContainerStarted","Data":"c5545bbdacc096124b298e0c328574eab0e67e474e976c6f411d1fae35eb6bca"}
Jul 28 12:51:15.602965 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.602776    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vlz98" event={"ID":"043bbf4c-91ea-4807-a459-dc1352806f89","Type":"ContainerStarted","Data":"2909a54a6ca8861729b4a08f88c1f45d3c7146c8e5f0af4026d9a0cf9f3e7ed5"}
Jul 28 12:51:15.611518 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.611395    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pkd5r" event={"ID":"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8","Type":"ContainerStarted","Data":"66a01807d472437f21752c78f104be3535a3b83b88725a5c325b08029b47ea52"}
Jul 28 12:51:15.617718 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.617655    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9947b" event={"ID":"5c974650-56f4-451e-a33c-48277a3ab1b9","Type":"ContainerStarted","Data":"16e604be6cd36a0c79eb073ebee40f609b18c678332450959bfadd79178c42ff"}
Jul 28 12:51:15.628051 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.628009    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6bhj" event={"ID":"afce1f60-fbcc-4321-8529-0ba85b567453","Type":"ContainerStarted","Data":"2a6b16440b3f29f392338e1968f44258ee35315ea78985562f0bb156fd3fec0c"}
Jul 28 12:51:15.637825 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.637750    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km" event={"ID":"04357d24-14c3-434a-b29f-39c2e5350a35","Type":"ContainerStarted","Data":"5b8fe383799d8e78b2e8fd5557cb35e0281b5f76aa2187cbc751744b4603948d"}
Jul 28 12:51:15.844006 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:15.843907    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:16.118694 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:16.117899    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:16.118694 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:16.118010    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:16.118694 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:16.118126    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:16.118694 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:16.118185    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs podName:8a9e1925-e5c5-453a-943f-2c472b87cd2a nodeName:}" failed. No retries permitted until 2026-07-28 12:51:18.118167383 +0000 UTC m=+5.047451293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs") pod "network-metrics-daemon-mnjqz" (UID: "8a9e1925-e5c5-453a-943f-2c472b87cd2a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:16.118694 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:16.118258    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:16.118694 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:16.118297    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret podName:8e112889-b95e-488a-b6f7-4b30b5253836 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:18.118285309 +0000 UTC m=+5.047569217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret") pod "global-pull-secret-syncer-smsrp" (UID: "8e112889-b95e-488a-b6f7-4b30b5253836") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:16.219062 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:16.219026    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtnr\" (UniqueName: \"kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr\") pod \"network-check-target-g4qxs\" (UID: \"a5338cba-14a3-4e40-b1c3-3d9e2586cad7\") " pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:16.219281 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:16.219262    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:16.219350 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:16.219289    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:16.219350 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:16.219302    2567 projected.go:196] Error preparing data for projected volume kube-api-access-hmtnr for pod openshift-network-diagnostics/network-check-target-g4qxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:16.219474 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:16.219358    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr podName:a5338cba-14a3-4e40-b1c3-3d9e2586cad7 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:18.219341617 +0000 UTC m=+5.148625515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmtnr" (UniqueName: "kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr") pod "network-check-target-g4qxs" (UID: "a5338cba-14a3-4e40-b1c3-3d9e2586cad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:16.476071 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:16.475967    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 12:46:14 +0000 UTC" deadline="2028-03-26 17:02:21.896535815 +0000 UTC"
Jul 28 12:51:16.476071 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:16.476021    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14572h11m5.42052192s"
Jul 28 12:51:16.495520 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:16.495486    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:16.495698 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:16.495639    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:16.496079 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:16.496058    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:16.496178 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:16.496156    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:17.070812 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:17.070782    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:17.473049 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:17.473011    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 12:51:17.497352 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:17.496392    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:17.497352 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:17.496524    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:18.132352 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:18.132309    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:18.132528 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:18.132382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:18.132583 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:18.132538    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:18.132631 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:18.132605    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret podName:8e112889-b95e-488a-b6f7-4b30b5253836 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:22.132585103 +0000 UTC m=+9.061869001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret") pod "global-pull-secret-syncer-smsrp" (UID: "8e112889-b95e-488a-b6f7-4b30b5253836") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:18.133035 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:18.133014    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:18.133133 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:18.133077    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs podName:8a9e1925-e5c5-453a-943f-2c472b87cd2a nodeName:}" failed. No retries permitted until 2026-07-28 12:51:22.133059684 +0000 UTC m=+9.062343579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs") pod "network-metrics-daemon-mnjqz" (UID: "8a9e1925-e5c5-453a-943f-2c472b87cd2a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:18.233069 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:18.233027    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtnr\" (UniqueName: \"kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr\") pod \"network-check-target-g4qxs\" (UID: \"a5338cba-14a3-4e40-b1c3-3d9e2586cad7\") " pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:18.233245 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:18.233205    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:18.233245 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:18.233226    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:18.233245 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:18.233239    2567 projected.go:196] Error preparing data for projected volume kube-api-access-hmtnr for pod openshift-network-diagnostics/network-check-target-g4qxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:18.233412 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:18.233301    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr podName:a5338cba-14a3-4e40-b1c3-3d9e2586cad7 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:22.233281572 +0000 UTC m=+9.162565467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmtnr" (UniqueName: "kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr") pod "network-check-target-g4qxs" (UID: "a5338cba-14a3-4e40-b1c3-3d9e2586cad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:18.495303 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:18.495214    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:18.495479 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:18.495367    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:18.495772 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:18.495752    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:18.495877 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:18.495858    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:19.496502 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:19.496028    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:19.496502 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:19.496167    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:20.495324 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:20.495286    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:20.495507 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:20.495342    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:20.495507 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:20.495433    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:20.495614 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:20.495586    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:21.499005 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:21.495936    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:21.499005 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:21.496159    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:22.167142 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:22.167102    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:22.167328 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:22.167165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:22.167328 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:22.167264    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:22.167328 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:22.167302    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:22.167497 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:22.167340    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs podName:8a9e1925-e5c5-453a-943f-2c472b87cd2a nodeName:}" failed. No retries permitted until 2026-07-28 12:51:30.167317793 +0000 UTC m=+17.096601692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs") pod "network-metrics-daemon-mnjqz" (UID: "8a9e1925-e5c5-453a-943f-2c472b87cd2a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:22.167497 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:22.167364    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret podName:8e112889-b95e-488a-b6f7-4b30b5253836 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:30.167350691 +0000 UTC m=+17.096634588 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret") pod "global-pull-secret-syncer-smsrp" (UID: "8e112889-b95e-488a-b6f7-4b30b5253836") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:22.268305 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:22.268270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtnr\" (UniqueName: \"kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr\") pod \"network-check-target-g4qxs\" (UID: \"a5338cba-14a3-4e40-b1c3-3d9e2586cad7\") " pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:22.268505 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:22.268426    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:22.268505 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:22.268451    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:22.268505 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:22.268464    2567 projected.go:196] Error preparing data for projected volume kube-api-access-hmtnr for pod openshift-network-diagnostics/network-check-target-g4qxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:22.268669 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:22.268533    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr podName:a5338cba-14a3-4e40-b1c3-3d9e2586cad7 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:30.268512003 +0000 UTC m=+17.197795901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmtnr" (UniqueName: "kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr") pod "network-check-target-g4qxs" (UID: "a5338cba-14a3-4e40-b1c3-3d9e2586cad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:22.495199 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:22.495111    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:22.495374 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:22.495237    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:22.495374 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:22.495308    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:22.495479 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:22.495381    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:23.495845 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:23.495789    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:23.496309 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:23.495904    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:24.494701 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:24.494666    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:24.494895 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:24.494666    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:24.494895 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:24.494783    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:24.495048 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:24.494889    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:25.495464 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:25.495422    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:25.495891 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:25.495562    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:26.494751 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:26.494708    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:26.494751 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:26.494737    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:26.495004 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:26.494856    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:26.495004 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:26.494982    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:27.494791 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:27.494754    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:27.495261 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:27.494874    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:28.494832 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:28.494796    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:28.495253 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:28.494797    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:28.495253 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:28.494903    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:28.495253 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:28.495028    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:29.494690 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:29.494647    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:29.494873 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:29.494781    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:30.224572 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:30.224526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:30.224866 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:30.224582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:30.224866 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:30.224675    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:30.224866 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:30.224739    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret podName:8e112889-b95e-488a-b6f7-4b30b5253836 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:46.22472021 +0000 UTC m=+33.154004105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret") pod "global-pull-secret-syncer-smsrp" (UID: "8e112889-b95e-488a-b6f7-4b30b5253836") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:30.224866 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:30.224675    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:30.224866 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:30.224817    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs podName:8a9e1925-e5c5-453a-943f-2c472b87cd2a nodeName:}" failed. No retries permitted until 2026-07-28 12:51:46.224802184 +0000 UTC m=+33.154086079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs") pod "network-metrics-daemon-mnjqz" (UID: "8a9e1925-e5c5-453a-943f-2c472b87cd2a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:30.325909 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:30.325869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtnr\" (UniqueName: \"kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr\") pod \"network-check-target-g4qxs\" (UID: \"a5338cba-14a3-4e40-b1c3-3d9e2586cad7\") " pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:30.326103 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:30.326018    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:30.326103 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:30.326042    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:30.326103 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:30.326054    2567 projected.go:196] Error preparing data for projected volume kube-api-access-hmtnr for pod openshift-network-diagnostics/network-check-target-g4qxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:30.326240 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:30.326117    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr podName:a5338cba-14a3-4e40-b1c3-3d9e2586cad7 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:46.326101605 +0000 UTC m=+33.255385500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmtnr" (UniqueName: "kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr") pod "network-check-target-g4qxs" (UID: "a5338cba-14a3-4e40-b1c3-3d9e2586cad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:30.495650 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:30.495562    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:30.496124 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:30.495566    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:30.496124 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:30.495681    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:30.496124 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:30.495850    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:31.494597 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:31.494542    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:31.494788 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:31.494682    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:32.495461 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:32.495276    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:32.495886 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:32.495340    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:32.495886 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:32.495561    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:32.495886 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:32.495641    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:33.498391 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:33.498095    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:33.498391 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:33.498265    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:34.494724 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.494693    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:34.494849 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:34.494816    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:34.494894 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.494877    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:34.494986 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:34.494953    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:34.692060 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.691633    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pkd5r" event={"ID":"e19218bb-f199-410e-b5c0-6bf7e7a7a4e8","Type":"ContainerStarted","Data":"277a5ef6b94aa7b9468c69e544f160a291bde1ad544e186458ae1acd1b1e93f7"}
Jul 28 12:51:34.693497 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.693466    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9947b" event={"ID":"5c974650-56f4-451e-a33c-48277a3ab1b9","Type":"ContainerStarted","Data":"60e4eb3aa2e32df2300295e54e80e90f62f50a10fb58f81acfc46560279d5e92"}
Jul 28 12:51:34.697608 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.697576    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6bhj" event={"ID":"afce1f60-fbcc-4321-8529-0ba85b567453","Type":"ContainerStarted","Data":"c1defe6d843c9a888c800f533609b3f18c3479a96507a2358e0e68557a0c05db"}
Jul 28 12:51:34.699474 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.699445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km" event={"ID":"04357d24-14c3-434a-b29f-39c2e5350a35","Type":"ContainerStarted","Data":"8186aa252bb9adfec14abdb42c382464fbe5f69d407a5de907cbc00159402672"}
Jul 28 12:51:34.700834 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.700803    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" event={"ID":"7aef2ed6ac42d45c959a5cf3a54001f5","Type":"ContainerStarted","Data":"01625c213c2987b4fcf6fa1287d6eceda6146de74ff1d9709d834498f7542acf"}
Jul 28 12:51:34.702212 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.702181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v4cfk" event={"ID":"2139ac10-b3ff-4ba1-8189-0d512d855d30","Type":"ContainerStarted","Data":"1e0a3bc1dae4f6b330b9a8e7a892aea2b439b37f8379b4caeebcfb12e1a07d47"}
Jul 28 12:51:34.703678 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.703653    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9zk5p" event={"ID":"e40068e5-fe90-4d0f-bedb-007c67c86f02","Type":"ContainerStarted","Data":"a8d911c7bfedf6286650e3cc245c56fa3d34fd8e786a60398f452afcc1fa7ef5"}
Jul 28 12:51:34.705727 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.705703    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" event={"ID":"2fd537ed-9ab5-4d16-bef1-957e19f15907","Type":"ContainerStarted","Data":"602128f62482aa6f4689539225a9d917dd2c157d4279b4bdd6468403fc8cb4ec"}
Jul 28 12:51:34.705822 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.705775    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" event={"ID":"2fd537ed-9ab5-4d16-bef1-957e19f15907","Type":"ContainerStarted","Data":"0954cdb1e7d721f005d6b8ebb8adde8726573646ce04991a7562a12394e76301"}
Jul 28 12:51:34.705884 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.705825    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" event={"ID":"2fd537ed-9ab5-4d16-bef1-957e19f15907","Type":"ContainerStarted","Data":"17f0c3ae9709a6782686d81b9129926d6ae87c5b73ad27ec0c8262b18ea2d9af"}
Jul 28 12:51:34.707045 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.707019    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6pcqf" event={"ID":"01ebce22-4e32-402d-98a7-351b2b60f3c5","Type":"ContainerStarted","Data":"9099b7a1e4214c9638eb96c9146bec57d2356ac7adc7d9b0ff430ef9f4efc41a"}
Jul 28 12:51:34.714466 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.714414    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pkd5r" podStartSLOduration=2.151868198 podStartE2EDuration="21.71440294s" totalImagesPullingTime="19.562534742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:34.714307818 +0000 UTC m=+21.643591735" watchObservedRunningTime="2026-07-28 12:51:34.71440294 +0000 UTC m=+21.643686857"
Jul 28 12:51:34.785761 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.785668    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r6bhj" podStartSLOduration=2.260428575 podStartE2EDuration="21.785649829s" totalImagesPullingTime="19.525221254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:34.765188278 +0000 UTC m=+21.694472216" watchObservedRunningTime="2026-07-28 12:51:34.785649829 +0000 UTC m=+21.714933746"
Jul 28 12:51:34.810897 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.810838    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-173.ec2.internal" podStartSLOduration=20.810818089 podStartE2EDuration="20.810818089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:34.785589908 +0000 UTC m=+21.714873826" watchObservedRunningTime="2026-07-28 12:51:34.810818089 +0000 UTC m=+21.740102007"
Jul 28 12:51:34.811112 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.811086    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9zk5p" podStartSLOduration=2.29762274 podStartE2EDuration="21.811074966s" totalImagesPullingTime="19.513452226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:34.810972128 +0000 UTC m=+21.740256060" watchObservedRunningTime="2026-07-28 12:51:34.811074966 +0000 UTC m=+21.740358883"
Jul 28 12:51:34.837957 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.837898    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v4cfk" podStartSLOduration=2.327935958 podStartE2EDuration="21.837883328s" totalImagesPullingTime="19.50994737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:34.837756217 +0000 UTC m=+21.767040134" watchObservedRunningTime="2026-07-28 12:51:34.837883328 +0000 UTC m=+21.767167244"
Jul 28 12:51:34.894736 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.894706    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:34.895588 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.895569    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:34.921402 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:34.921365    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6pcqf" podStartSLOduration=2.3744808 podStartE2EDuration="21.921348702s" totalImagesPullingTime="19.546867902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:34.869344178 +0000 UTC m=+21.798628095" watchObservedRunningTime="2026-07-28 12:51:34.921348702 +0000 UTC m=+21.850632597"
Jul 28 12:51:35.495400 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.495214    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:35.495589 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:35.495508    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:35.711455 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.711425    2567 generic.go:356] "Generic (PLEG): container finished" podID="305f5fbdf10083198ddc2b41e9e0dffe" containerID="4903827fee9488d8c12af89c8e4ae1cb8078324f8a126e6d4df08dc347efbe4a" exitCode=0
Jul 28 12:51:35.711832 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.711513    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" event={"ID":"305f5fbdf10083198ddc2b41e9e0dffe","Type":"ContainerDied","Data":"4903827fee9488d8c12af89c8e4ae1cb8078324f8a126e6d4df08dc347efbe4a"}
Jul 28 12:51:35.713069 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.713040    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vlz98" event={"ID":"043bbf4c-91ea-4807-a459-dc1352806f89","Type":"ContainerStarted","Data":"0974060d34983cdf3c56bacc07894a20914c243fce4366fc2607a80d4dacc673"}
Jul 28 12:51:35.714634 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.714608    2567 generic.go:356] "Generic (PLEG): container finished" podID="5c974650-56f4-451e-a33c-48277a3ab1b9" containerID="60e4eb3aa2e32df2300295e54e80e90f62f50a10fb58f81acfc46560279d5e92" exitCode=0
Jul 28 12:51:35.714724 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.714696    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9947b" event={"ID":"5c974650-56f4-451e-a33c-48277a3ab1b9","Type":"ContainerDied","Data":"60e4eb3aa2e32df2300295e54e80e90f62f50a10fb58f81acfc46560279d5e92"}
Jul 28 12:51:35.718013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.717988    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" event={"ID":"2fd537ed-9ab5-4d16-bef1-957e19f15907","Type":"ContainerStarted","Data":"20cc81a70166745643e2b2f0f52faa889295091038bf3cf581a04403611f44bf"}
Jul 28 12:51:35.718105 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.718076    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" event={"ID":"2fd537ed-9ab5-4d16-bef1-957e19f15907","Type":"ContainerStarted","Data":"6862daa9ebac066782bc97dcdd71cbd05be049f44a0e3197102282179c1b97c5"}
Jul 28 12:51:35.718161 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.718113    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" event={"ID":"2fd537ed-9ab5-4d16-bef1-957e19f15907","Type":"ContainerStarted","Data":"24d08ecc63a14e9a807fc7560d9653707a588e3389435d2f0902a61d677a5588"}
Jul 28 12:51:35.766413 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.766388    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 12:51:35.787562 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:35.787515    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vlz98" podStartSLOduration=3.297139731 podStartE2EDuration="22.787500235s" totalImagesPullingTime="19.490360504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:35.758671784 +0000 UTC m=+22.687955705" watchObservedRunningTime="2026-07-28 12:51:35.787500235 +0000 UTC m=+22.716784148"
Jul 28 12:51:36.476426 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:36.476318    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T12:51:35.766406495Z","UUID":"2ebaa8f4-ddc4-4077-a630-8a1888fbfb1c","Handler":null,"Name":"","Endpoint":""}
Jul 28 12:51:36.478052 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:36.478031    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 12:51:36.478231 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:36.478073    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 12:51:36.495100 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:36.495064    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:36.495100 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:36.495084    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:36.495327 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:36.495189    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:36.495327 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:36.495266    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:36.722648 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:36.722608    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" event={"ID":"305f5fbdf10083198ddc2b41e9e0dffe","Type":"ContainerStarted","Data":"cccdf47f3f784b9d73e3059e7747768777cbb133fe0ebc52b51994d967432bf9"}
Jul 28 12:51:36.724968 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:36.724912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km" event={"ID":"04357d24-14c3-434a-b29f-39c2e5350a35","Type":"ContainerStarted","Data":"c8ad238ae4bf254a18954a23ca945a61eae27393e3d678e9553012c3b5da578e"}
Jul 28 12:51:36.725113 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:36.724977    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 12:51:37.495096 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:37.495006    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:37.495271 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:37.495137    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:37.731320 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:37.731283    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" event={"ID":"2fd537ed-9ab5-4d16-bef1-957e19f15907","Type":"ContainerStarted","Data":"4bac2e9fd86376272b1e6b146c90f8953e0bd36860dd8166895fb1ab3245ce46"}
Jul 28 12:51:37.733378 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:37.733346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km" event={"ID":"04357d24-14c3-434a-b29f-39c2e5350a35","Type":"ContainerStarted","Data":"27323e209a238d927c369c42a1f5625f3ec09f23a07f2c318ee3841e99c5df7e"}
Jul 28 12:51:37.754833 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:37.754734    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q55km" podStartSLOduration=2.945438159 podStartE2EDuration="24.754718768s" totalImagesPullingTime="21.809280609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:37.75448502 +0000 UTC m=+24.683768959" watchObservedRunningTime="2026-07-28 12:51:37.754718768 +0000 UTC m=+24.684002685"
Jul 28 12:51:37.754997 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:37.754864    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-173.ec2.internal" podStartSLOduration=23.75485858 podStartE2EDuration="23.75485858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:36.741441364 +0000 UTC m=+23.670725282" watchObservedRunningTime="2026-07-28 12:51:37.75485858 +0000 UTC m=+24.684142497"
Jul 28 12:51:38.494992 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:38.494958    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:38.494992 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:38.494989    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:38.495198 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:38.495079    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:38.495198 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:38.495180    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:39.495099 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:39.495013    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:39.495555 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:39.495153    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:40.388621 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:40.388390    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:40.494866 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:40.494826    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:40.495077 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:40.494826    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:40.495077 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:40.494987    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:40.495817 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:40.495094    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:40.520503 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:40.520472    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:40.745088 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:40.744998    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" event={"ID":"2fd537ed-9ab5-4d16-bef1-957e19f15907","Type":"ContainerStarted","Data":"2d971d8ed76ef4d714c6e13ada8a78a802c742dd33d8aa7040437a33ef8c04c2"}
Jul 28 12:51:40.745338 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:40.745314    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:40.747324 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:40.747304    2567 generic.go:356] "Generic (PLEG): container finished" podID="5c974650-56f4-451e-a33c-48277a3ab1b9" containerID="7c9765eeae060d9b2712ea30825f71592d444e4d7e4d3dee80ebe49746004ce8" exitCode=0
Jul 28 12:51:40.747442 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:40.747337    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9947b" event={"ID":"5c974650-56f4-451e-a33c-48277a3ab1b9","Type":"ContainerDied","Data":"7c9765eeae060d9b2712ea30825f71592d444e4d7e4d3dee80ebe49746004ce8"}
Jul 28 12:51:40.761380 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:40.761355    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:40.805447 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:40.805402    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" podStartSLOduration=8.177677747 podStartE2EDuration="27.805387021s" totalImagesPullingTime="19.627709274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:40.780755501 +0000 UTC m=+27.710039417" watchObservedRunningTime="2026-07-28 12:51:40.805387021 +0000 UTC m=+27.734670919"
Jul 28 12:51:41.498429 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:41.498236    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:41.498937 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:41.498519    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:41.751962 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:41.751936    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 12:51:41.752351 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:41.752333    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:41.767755 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:41.767732    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:42.102081 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.102048    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g4qxs"]
Jul 28 12:51:42.102262 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.102174    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:42.102322 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:42.102266    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:42.105798 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.105766    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-smsrp"]
Jul 28 12:51:42.105979 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.105937    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:42.106058 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:42.106033    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:42.106514 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.106490    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mnjqz"]
Jul 28 12:51:42.106622 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.106609    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:42.106734 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:42.106714    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:42.754615 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.754579    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:42.756552 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.756532    2567 generic.go:356] "Generic (PLEG): container finished" podID="5c974650-56f4-451e-a33c-48277a3ab1b9" containerID="2d9961d5cbfa4ddcce6b120ee4e677cf320ad44ef77a8ef61557598ab7ae3bef" exitCode=0
Jul 28 12:51:42.756660 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.756614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9947b" event={"ID":"5c974650-56f4-451e-a33c-48277a3ab1b9","Type":"ContainerDied","Data":"2d9961d5cbfa4ddcce6b120ee4e677cf320ad44ef77a8ef61557598ab7ae3bef"}
Jul 28 12:51:42.756660 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.756648    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 12:51:42.844304 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:42.844265    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:43.099027 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:43.098995    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:51:43.458960 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:43.458908    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:43.459129 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:43.459084    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 12:51:43.459600 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:43.459578    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6pcqf"
Jul 28 12:51:43.495264 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:43.495233    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:43.495407 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:43.495320    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:43.495407 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:43.495380    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:43.495495 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:43.495481    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:43.495547 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:43.495510    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:43.495588 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:43.495549    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:43.546169 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:43.546131    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:44.764022 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:44.763824    2567 generic.go:356] "Generic (PLEG): container finished" podID="5c974650-56f4-451e-a33c-48277a3ab1b9" containerID="0d895e60837379d47579347045f676ea7d5096a9b707b1f0d434d9c5aab1e389" exitCode=0
Jul 28 12:51:44.764474 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:44.763940    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9947b" event={"ID":"5c974650-56f4-451e-a33c-48277a3ab1b9","Type":"ContainerDied","Data":"0d895e60837379d47579347045f676ea7d5096a9b707b1f0d434d9c5aab1e389"}
Jul 28 12:51:44.783827 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:44.783782    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd" podUID="2fd537ed-9ab5-4d16-bef1-957e19f15907" containerName="ovnkube-controller" probeResult="failure" output=""
Jul 28 12:51:45.495035 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:45.494996    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:45.495226 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:45.494996    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:45.495226 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:45.495128    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g4qxs" podUID="a5338cba-14a3-4e40-b1c3-3d9e2586cad7"
Jul 28 12:51:45.495226 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:45.494996    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:45.495372 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:45.495178    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mnjqz" podUID="8a9e1925-e5c5-453a-943f-2c472b87cd2a"
Jul 28 12:51:45.495372 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:45.495298    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smsrp" podUID="8e112889-b95e-488a-b6f7-4b30b5253836"
Jul 28 12:51:45.509373 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:45.509339    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:46.238328 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:46.238296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:46.238753 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:46.238341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:46.238753 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:46.238462    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:46.238753 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:46.238531    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret podName:8e112889-b95e-488a-b6f7-4b30b5253836 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:18.238513483 +0000 UTC m=+65.167797383 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret") pod "global-pull-secret-syncer-smsrp" (UID: "8e112889-b95e-488a-b6f7-4b30b5253836") : object "kube-system"/"original-pull-secret" not registered
Jul 28 12:51:46.238753 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:46.238462    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:46.238753 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:46.238610    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs podName:8a9e1925-e5c5-453a-943f-2c472b87cd2a nodeName:}" failed. No retries permitted until 2026-07-28 12:52:18.238590707 +0000 UTC m=+65.167874609 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs") pod "network-metrics-daemon-mnjqz" (UID: "8a9e1925-e5c5-453a-943f-2c472b87cd2a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 12:51:46.339262 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:46.339228    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtnr\" (UniqueName: \"kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr\") pod \"network-check-target-g4qxs\" (UID: \"a5338cba-14a3-4e40-b1c3-3d9e2586cad7\") " pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:46.339440 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:46.339365    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 12:51:46.339440 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:46.339381    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 12:51:46.339440 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:46.339390    2567 projected.go:196] Error preparing data for projected volume kube-api-access-hmtnr for pod openshift-network-diagnostics/network-check-target-g4qxs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:46.339563 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:46.339441    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr podName:a5338cba-14a3-4e40-b1c3-3d9e2586cad7 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:18.339425426 +0000 UTC m=+65.268709324 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmtnr" (UniqueName: "kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr") pod "network-check-target-g4qxs" (UID: "a5338cba-14a3-4e40-b1c3-3d9e2586cad7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 12:51:47.346769 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.346736    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-173.ec2.internal" event="NodeReady"
Jul 28 12:51:47.347257 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.346879    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 12:51:47.402742 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.402708    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-56thl"]
Jul 28 12:51:47.408130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.408098    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76585448c6-qg77j"]
Jul 28 12:51:47.408277 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.408215    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.411039 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.411014    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 12:51:47.411161 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.411086    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 12:51:47.411597 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.411574    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ng9ss"]
Jul 28 12:51:47.411720 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.411704    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.413081 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.413061    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wxrjt\""
Jul 28 12:51:47.413963 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.413945    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q9wzr\""
Jul 28 12:51:47.414092 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.414067    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 12:51:47.414787 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.414768    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 12:51:47.415150 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.415131    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 12:51:47.415150 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.415249    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ng9ss"
Jul 28 12:51:47.419081 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.418866    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 12:51:47.419081 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.418949    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 12:51:47.419081 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.419059    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 12:51:47.419344 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.419311    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qldgx\""
Jul 28 12:51:47.420188 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.420080    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-56thl"]
Jul 28 12:51:47.422188 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.422165    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 12:51:47.422767 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.422745    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ng9ss"]
Jul 28 12:51:47.426758 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.426725    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76585448c6-qg77j"]
Jul 28 12:51:47.495467 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.495428    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:51:47.495661 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.495429    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:51:47.495661 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.495578    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:51:47.499218 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.499195    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 12:51:47.499343 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.499195    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n8x7n\""
Jul 28 12:51:47.499418 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.499348    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 12:51:47.499477 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.499414    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 12:51:47.499477 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.499450    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 12:51:47.499904 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.499882    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lcpbt\""
Jul 28 12:51:47.545767 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.545725    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:47.545973 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.545820    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz544\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-kube-api-access-bz544\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.545973 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.545898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-image-registry-private-configuration\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.545973 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.545959    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.546136 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.545991    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-bound-sa-token\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.546136 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.546017    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/093496a4-0e54-4910-9955-dcbba7e4d473-ca-trust-extracted\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.546136 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.546070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qgbn\" (UniqueName: \"kubernetes.io/projected/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-kube-api-access-8qgbn\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.546136 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.546093    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-config-volume\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.546323 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.546110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a505de-a8f4-4d35-bcd3-968edd6d9ff5-cert\") pod \"ingress-canary-ng9ss\" (UID: \"98a505de-a8f4-4d35-bcd3-968edd6d9ff5\") " pod="openshift-ingress-canary/ingress-canary-ng9ss"
Jul 28 12:51:47.546323 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.546172    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-registry-certificates\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.546323 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.546211    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-installation-pull-secrets\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.546323 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.546247    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.546323 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.546282    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-trusted-ca\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.546323 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.546310    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-tmp-dir\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.546508 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.546331    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlz8c\" (UniqueName: \"kubernetes.io/projected/98a505de-a8f4-4d35-bcd3-968edd6d9ff5-kube-api-access-dlz8c\") pod \"ingress-canary-ng9ss\" (UID: \"98a505de-a8f4-4d35-bcd3-968edd6d9ff5\") " pod="openshift-ingress-canary/ingress-canary-ng9ss"
Jul 28 12:51:47.613973 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.613877    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:47.646885 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.646853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qgbn\" (UniqueName: \"kubernetes.io/projected/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-kube-api-access-8qgbn\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.646885 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.646893    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-config-volume\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.647161 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.646937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a505de-a8f4-4d35-bcd3-968edd6d9ff5-cert\") pod \"ingress-canary-ng9ss\" (UID: \"98a505de-a8f4-4d35-bcd3-968edd6d9ff5\") " pod="openshift-ingress-canary/ingress-canary-ng9ss"
Jul 28 12:51:47.647161 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.646987    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-registry-certificates\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.647161 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.647012    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-installation-pull-secrets\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.648197 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:47.647869    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:47.648367 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.648344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-registry-certificates\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.648441 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.648402    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-config-volume\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.648487 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.648448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.648536 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.648492    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-trusted-ca\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.648701 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:47.648646    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls podName:2900e2c5-02ba-4f9d-909a-85f7bc0dd0da nodeName:}" failed. No retries permitted until 2026-07-28 12:51:48.148512884 +0000 UTC m=+35.077796798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls") pod "dns-default-56thl" (UID: "2900e2c5-02ba-4f9d-909a-85f7bc0dd0da") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:47.648701 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.648689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-tmp-dir\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.648842 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.648733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlz8c\" (UniqueName: \"kubernetes.io/projected/98a505de-a8f4-4d35-bcd3-968edd6d9ff5-kube-api-access-dlz8c\") pod \"ingress-canary-ng9ss\" (UID: \"98a505de-a8f4-4d35-bcd3-968edd6d9ff5\") " pod="openshift-ingress-canary/ingress-canary-ng9ss"
Jul 28 12:51:47.648895 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.648845    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz544\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-kube-api-access-bz544\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.648961 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.648932    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-image-registry-private-configuration\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.650013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.648970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.650013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.649116    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-bound-sa-token\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.650013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.649271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/093496a4-0e54-4910-9955-dcbba7e4d473-ca-trust-extracted\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.650013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.649367    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-tmp-dir\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.650013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.649981    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/093496a4-0e54-4910-9955-dcbba7e4d473-ca-trust-extracted\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.650317 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:47.650018    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:47.650317 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:47.650034    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76585448c6-qg77j: secret "image-registry-tls" not found
Jul 28 12:51:47.651605 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:47.650637    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls podName:093496a4-0e54-4910-9955-dcbba7e4d473 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:48.150617196 +0000 UTC m=+35.079901095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls") pod "image-registry-76585448c6-qg77j" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473") : secret "image-registry-tls" not found
Jul 28 12:51:47.652534 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.652509    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-trusted-ca\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.652841 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.652806    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-installation-pull-secrets\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.653679 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.653656    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-image-registry-private-configuration\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.653804 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.653766    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a505de-a8f4-4d35-bcd3-968edd6d9ff5-cert\") pod \"ingress-canary-ng9ss\" (UID: \"98a505de-a8f4-4d35-bcd3-968edd6d9ff5\") " pod="openshift-ingress-canary/ingress-canary-ng9ss"
Jul 28 12:51:47.656672 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.656648    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qgbn\" (UniqueName: \"kubernetes.io/projected/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-kube-api-access-8qgbn\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:47.659979 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.659954    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-bound-sa-token\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.668524 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.668501    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz544\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-kube-api-access-bz544\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:47.668686 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.668659    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlz8c\" (UniqueName: \"kubernetes.io/projected/98a505de-a8f4-4d35-bcd3-968edd6d9ff5-kube-api-access-dlz8c\") pod \"ingress-canary-ng9ss\" (UID: \"98a505de-a8f4-4d35-bcd3-968edd6d9ff5\") " pod="openshift-ingress-canary/ingress-canary-ng9ss"
Jul 28 12:51:47.735306 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:47.735263    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ng9ss"
Jul 28 12:51:48.153239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:48.153145    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:48.153419 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:48.153270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:48.153419 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:48.153304    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:48.153419 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:48.153328    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76585448c6-qg77j: secret "image-registry-tls" not found
Jul 28 12:51:48.153419 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:48.153399    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls podName:093496a4-0e54-4910-9955-dcbba7e4d473 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:49.153376956 +0000 UTC m=+36.082660854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls") pod "image-registry-76585448c6-qg77j" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473") : secret "image-registry-tls" not found
Jul 28 12:51:48.153419 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:48.153408    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:48.153622 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:48.153457    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls podName:2900e2c5-02ba-4f9d-909a-85f7bc0dd0da nodeName:}" failed. No retries permitted until 2026-07-28 12:51:49.153442868 +0000 UTC m=+36.082726763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls") pod "dns-default-56thl" (UID: "2900e2c5-02ba-4f9d-909a-85f7bc0dd0da") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:48.971809 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:48.971660    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ng9ss"]
Jul 28 12:51:48.975174 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:48.975136    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a505de_a8f4_4d35_bcd3_968edd6d9ff5.slice/crio-2ed71f30fd023d738c740f6f5b32147ca4d6e0ee37d1f9201f74f2a114e86c35 WatchSource:0}: Error finding container 2ed71f30fd023d738c740f6f5b32147ca4d6e0ee37d1f9201f74f2a114e86c35: Status 404 returned error can't find the container with id 2ed71f30fd023d738c740f6f5b32147ca4d6e0ee37d1f9201f74f2a114e86c35
Jul 28 12:51:49.161392 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:49.161358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:49.161543 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:49.161427    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:49.161543 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:49.161526    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:49.161625 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:49.161561    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:49.161625 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:49.161573    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76585448c6-qg77j: secret "image-registry-tls" not found
Jul 28 12:51:49.161625 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:49.161598    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls podName:2900e2c5-02ba-4f9d-909a-85f7bc0dd0da nodeName:}" failed. No retries permitted until 2026-07-28 12:51:51.161577062 +0000 UTC m=+38.090860972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls") pod "dns-default-56thl" (UID: "2900e2c5-02ba-4f9d-909a-85f7bc0dd0da") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:49.161625 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:49.161615    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls podName:093496a4-0e54-4910-9955-dcbba7e4d473 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:51.16160743 +0000 UTC m=+38.090891329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls") pod "image-registry-76585448c6-qg77j" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473") : secret "image-registry-tls" not found
Jul 28 12:51:49.778985 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:49.778947    2567 generic.go:356] "Generic (PLEG): container finished" podID="5c974650-56f4-451e-a33c-48277a3ab1b9" containerID="c11e043bfd2599e0c14f3318fe30a959d61f7e81a4defb87241f71c64905ed40" exitCode=0
Jul 28 12:51:49.779175 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:49.779037    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9947b" event={"ID":"5c974650-56f4-451e-a33c-48277a3ab1b9","Type":"ContainerDied","Data":"c11e043bfd2599e0c14f3318fe30a959d61f7e81a4defb87241f71c64905ed40"}
Jul 28 12:51:49.780151 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:49.780128    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ng9ss" event={"ID":"98a505de-a8f4-4d35-bcd3-968edd6d9ff5","Type":"ContainerStarted","Data":"2ed71f30fd023d738c740f6f5b32147ca4d6e0ee37d1f9201f74f2a114e86c35"}
Jul 28 12:51:49.836381 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:49.836342    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:49.939869 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:49.939835    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:50.628685 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.628646    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:50.753399 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.753370    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz"]
Jul 28 12:51:50.756191 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.756158    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:50.772554 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.772524    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz"]
Jul 28 12:51:50.772711 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.772636    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz"
Jul 28 12:51:50.776875 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.776849    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 12:51:50.777749 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.777727    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gzjt6\""
Jul 28 12:51:50.778165 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.778150    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 12:51:50.786201 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.786165    2567 generic.go:356] "Generic (PLEG): container finished" podID="5c974650-56f4-451e-a33c-48277a3ab1b9" containerID="6863b1bbe04c86f6b388e34bb700fb49f9a6b5c68bb241222d363c68a9c1074c" exitCode=0
Jul 28 12:51:50.786314 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.786241    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9947b" event={"ID":"5c974650-56f4-451e-a33c-48277a3ab1b9","Type":"ContainerDied","Data":"6863b1bbe04c86f6b388e34bb700fb49f9a6b5c68bb241222d363c68a9c1074c"}
Jul 28 12:51:50.853654 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.853612    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:50.875651 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.875612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92pt6\" (UniqueName: \"kubernetes.io/projected/b3d76279-c0b1-46d6-b8b5-3011de9ef2e4-kube-api-access-92pt6\") pod \"migrator-6865c9967-bkxwz\" (UID: \"b3d76279-c0b1-46d6-b8b5-3011de9ef2e4\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz"
Jul 28 12:51:50.925944 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.925831    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:50.976739 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.976702    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92pt6\" (UniqueName: \"kubernetes.io/projected/b3d76279-c0b1-46d6-b8b5-3011de9ef2e4-kube-api-access-92pt6\") pod \"migrator-6865c9967-bkxwz\" (UID: \"b3d76279-c0b1-46d6-b8b5-3011de9ef2e4\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz"
Jul 28 12:51:50.989325 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:50.989296    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92pt6\" (UniqueName: \"kubernetes.io/projected/b3d76279-c0b1-46d6-b8b5-3011de9ef2e4-kube-api-access-92pt6\") pod \"migrator-6865c9967-bkxwz\" (UID: \"b3d76279-c0b1-46d6-b8b5-3011de9ef2e4\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz"
Jul 28 12:51:51.083624 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.083589    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz"
Jul 28 12:51:51.133882 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.133845    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ssjr7"]
Jul 28 12:51:51.144575 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.144546    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.147229 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.147206    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 12:51:51.147448 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.147292    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wb5jb\""
Jul 28 12:51:51.147448 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.147291    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 12:51:51.147558 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.147543    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 12:51:51.147558 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.147552    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 12:51:51.158196 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.158167    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ssjr7"]
Jul 28 12:51:51.178884 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.178812    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:51.179051 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.178903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:51.179051 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.178947    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:51.179051 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.178963    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76585448c6-qg77j: secret "image-registry-tls" not found
Jul 28 12:51:51.179051 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.179018    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls podName:093496a4-0e54-4910-9955-dcbba7e4d473 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:55.178999416 +0000 UTC m=+42.108283328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls") pod "image-registry-76585448c6-qg77j" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473") : secret "image-registry-tls" not found
Jul 28 12:51:51.179051 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.179024    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:51.179292 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.179069    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls podName:2900e2c5-02ba-4f9d-909a-85f7bc0dd0da nodeName:}" failed. No retries permitted until 2026-07-28 12:51:55.179055893 +0000 UTC m=+42.108339789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls") pod "dns-default-56thl" (UID: "2900e2c5-02ba-4f9d-909a-85f7bc0dd0da") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:51.193581 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.193540    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:51.280029 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.279994    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-data-volume\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.280218 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.280040    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9gnd\" (UniqueName: \"kubernetes.io/projected/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-api-access-q9gnd\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.280218 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.280117    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.280321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.280216    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-crio-socket\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.280321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.280278    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.354997 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.354932    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:51.380683 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.380652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-crio-socket\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.380837 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.380763    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-crio-socket\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.380837 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.380809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.380911 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.380878    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:51:51.380911 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.380904    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-data-volume\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.380998 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.380940    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm podName:6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:51.880913237 +0000 UTC m=+38.810197133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ssjr7" (UID: "6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896") : configmap "kube-rbac-proxy" not found
Jul 28 12:51:51.380998 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.380953    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gnd\" (UniqueName: \"kubernetes.io/projected/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-api-access-q9gnd\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.380998 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.380977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.381103 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.381061    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:51.381103 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.381093    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls podName:6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:51.881082589 +0000 UTC m=+38.810366485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssjr7" (UID: "6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:51.381173 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.381164    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-data-volume\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.400271 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.400221    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gnd\" (UniqueName: \"kubernetes.io/projected/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-api-access-q9gnd\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.448169 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.448027    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:51.555410 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.555134    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz"]
Jul 28 12:51:51.572713 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:51.572679    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d76279_c0b1_46d6_b8b5_3011de9ef2e4.slice/crio-f9f136761b77cca66f4558231a02613327e5eb3ea08cf546badcf59f2ff6839a WatchSource:0}: Error finding container f9f136761b77cca66f4558231a02613327e5eb3ea08cf546badcf59f2ff6839a: Status 404 returned error can't find the container with id f9f136761b77cca66f4558231a02613327e5eb3ea08cf546badcf59f2ff6839a
Jul 28 12:51:51.652846 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.652811    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:51.753258 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.753210    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:51.792650 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.792615    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9947b" event={"ID":"5c974650-56f4-451e-a33c-48277a3ab1b9","Type":"ContainerStarted","Data":"ac758cf6b102ce34a7df3c27d059b847863bd42ad0fe4c4d41e8db6a05c2c728"}
Jul 28 12:51:51.795902 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.795869    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ng9ss" event={"ID":"98a505de-a8f4-4d35-bcd3-968edd6d9ff5","Type":"ContainerStarted","Data":"36cd526789bc8a53ae2b8246e137eb840367dc9da5f7efa0d2b23f20a6b48194"}
Jul 28 12:51:51.796962 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.796935    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz" event={"ID":"b3d76279-c0b1-46d6-b8b5-3011de9ef2e4","Type":"ContainerStarted","Data":"f9f136761b77cca66f4558231a02613327e5eb3ea08cf546badcf59f2ff6839a"}
Jul 28 12:51:51.829788 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.829734    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9947b" podStartSLOduration=9.079000513 podStartE2EDuration="38.829719345s" totalImagesPullingTime="29.750718832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:51.828653391 +0000 UTC m=+38.757937310" watchObservedRunningTime="2026-07-28 12:51:51.829719345 +0000 UTC m=+38.759003263"
Jul 28 12:51:51.835574 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.835538    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:51.850644 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.850592    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ng9ss" podStartSLOduration=2.215474256 podStartE2EDuration="4.85057396s" totalImagesPullingTime="2.635099704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:51.848835652 +0000 UTC m=+38.778119570" watchObservedRunningTime="2026-07-28 12:51:51.85057396 +0000 UTC m=+38.779857876"
Jul 28 12:51:51.885405 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.885360    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.886170 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.885459    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:51:51.886170 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.885486    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:51.886170 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.885534    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm podName:6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:52.885512138 +0000 UTC m=+39.814796049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ssjr7" (UID: "6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896") : configmap "kube-rbac-proxy" not found
Jul 28 12:51:51.886170 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.885590    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:51.886170 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:51.885641    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls podName:6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:52.885625027 +0000 UTC m=+39.814908937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssjr7" (UID: "6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:51.950750 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:51.950714    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:52.018831 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:52.018797    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:52.164415 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:52.164382    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:52.238845 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:52.238812    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:52.762012 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:52.761896    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:52.825339 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:52.825304    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:52.895899 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:52.895858    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:52.896093 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:52.895938    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:51:52.896093 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:52.895995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:52.896093 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:52.896019    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm podName:6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:54.895997169 +0000 UTC m=+41.825281064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ssjr7" (UID: "6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896") : configmap "kube-rbac-proxy" not found
Jul 28 12:51:52.896093 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:52.896082    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:52.896413 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:52.896131    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls podName:6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:54.896116006 +0000 UTC m=+41.825399902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssjr7" (UID: "6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:52.985400 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:52.985366    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-p2cqk"]
Jul 28 12:51:53.008988 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.008954    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-p2cqk"]
Jul 28 12:51:53.009153 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.009050    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.011824 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.011801    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 12:51:53.011953 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.011832    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 12:51:53.011953 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.011838    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 12:51:53.011953 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.011859    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 12:51:53.012996 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.012947    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-p56l5\""
Jul 28 12:51:53.057932 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.057891    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:53.097968 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.097911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b-signing-cabundle\") pod \"service-ca-658d7b7c78-p2cqk\" (UID: \"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b\") " pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.098122 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.098061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b-signing-key\") pod \"service-ca-658d7b7c78-p2cqk\" (UID: \"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b\") " pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.098122 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.098103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4mk\" (UniqueName: \"kubernetes.io/projected/d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b-kube-api-access-tx4mk\") pod \"service-ca-658d7b7c78-p2cqk\" (UID: \"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b\") " pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.133301 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.133267    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:53.199175 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.199133    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b-signing-key\") pod \"service-ca-658d7b7c78-p2cqk\" (UID: \"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b\") " pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.199335 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.199190    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4mk\" (UniqueName: \"kubernetes.io/projected/d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b-kube-api-access-tx4mk\") pod \"service-ca-658d7b7c78-p2cqk\" (UID: \"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b\") " pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.199335 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.199221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b-signing-cabundle\") pod \"service-ca-658d7b7c78-p2cqk\" (UID: \"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b\") " pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.199858 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.199838    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b-signing-cabundle\") pod \"service-ca-658d7b7c78-p2cqk\" (UID: \"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b\") " pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.202389 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.202368    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b-signing-key\") pod \"service-ca-658d7b7c78-p2cqk\" (UID: \"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b\") " pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.210017 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.209986    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4mk\" (UniqueName: \"kubernetes.io/projected/d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b-kube-api-access-tx4mk\") pod \"service-ca-658d7b7c78-p2cqk\" (UID: \"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b\") " pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.321489 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.321465    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk"
Jul 28 12:51:53.492263 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.492163    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-p2cqk"]
Jul 28 12:51:53.496086 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:51:53.496054    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b2e8f3_960e_4dc6_b09f_ffb9b2f4a44b.slice/crio-a6a143df23807a94761a0ba5672e3257ea16288616d89e7448cf3651e8bcbc87 WatchSource:0}: Error finding container a6a143df23807a94761a0ba5672e3257ea16288616d89e7448cf3651e8bcbc87: Status 404 returned error can't find the container with id a6a143df23807a94761a0ba5672e3257ea16288616d89e7448cf3651e8bcbc87
Jul 28 12:51:53.664397 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.664316    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v4cfk_2139ac10-b3ff-4ba1-8189-0d512d855d30/dns-node-resolver/0.log"
Jul 28 12:51:53.751276 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.751248    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:53.803677 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.803639    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz" event={"ID":"b3d76279-c0b1-46d6-b8b5-3011de9ef2e4","Type":"ContainerStarted","Data":"2a4d054e67cf33632163d2296fca8f7790c61eb080e46d69c9a75deea67c12d3"}
Jul 28 12:51:53.804119 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.803707    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz" event={"ID":"b3d76279-c0b1-46d6-b8b5-3011de9ef2e4","Type":"ContainerStarted","Data":"d24575d145371d9f406d5dc8ec61fca89349a94cd9bb1bc3794f99fd85e9a854"}
Jul 28 12:51:53.804823 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.804803    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk" event={"ID":"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b","Type":"ContainerStarted","Data":"a6a143df23807a94761a0ba5672e3257ea16288616d89e7448cf3651e8bcbc87"}
Jul 28 12:51:53.842546 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.842497    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-bkxwz" podStartSLOduration=2.158230017 podStartE2EDuration="3.842480295s" totalImagesPullingTime="1.684250278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:53.840152187 +0000 UTC m=+40.769436103" watchObservedRunningTime="2026-07-28 12:51:53.842480295 +0000 UTC m=+40.771764212"
Jul 28 12:51:53.909887 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:53.909848    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:54.003910 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:54.003823    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:54.105275 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:54.105240    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:54.263877 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:54.263797    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9zk5p_e40068e5-fe90-4d0f-bedb-007c67c86f02/node-ca/0.log"
Jul 28 12:51:54.376295 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:54.376259    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:54.913427 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:54.913387    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:54.913908 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:54.913496    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:54.913908 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:54.913500    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:54.913908 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:54.913560    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 12:51:54.913908 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:54.913566    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls podName:6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:58.913544861 +0000 UTC m=+45.842828756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssjr7" (UID: "6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:54.913908 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:54.913626    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm podName:6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896 nodeName:}" failed. No retries permitted until 2026-07-28 12:51:58.913613778 +0000 UTC m=+45.842897683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ssjr7" (UID: "6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896") : configmap "kube-rbac-proxy" not found
Jul 28 12:51:55.216271 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:55.216180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:51:55.216448 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:55.216305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:51:55.216448 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:55.216359    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 12:51:55.216448 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:55.216429    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 12:51:55.216448 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:55.216439    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls podName:2900e2c5-02ba-4f9d-909a-85f7bc0dd0da nodeName:}" failed. No retries permitted until 2026-07-28 12:52:03.216418141 +0000 UTC m=+50.145702038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls") pod "dns-default-56thl" (UID: "2900e2c5-02ba-4f9d-909a-85f7bc0dd0da") : secret "dns-default-metrics-tls" not found
Jul 28 12:51:55.216448 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:55.216444    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76585448c6-qg77j: secret "image-registry-tls" not found
Jul 28 12:51:55.216616 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:55.216490    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls podName:093496a4-0e54-4910-9955-dcbba7e4d473 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:03.216477909 +0000 UTC m=+50.145761804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls") pod "image-registry-76585448c6-qg77j" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473") : secret "image-registry-tls" not found
Jul 28 12:51:55.279883 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:55.279830    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ng9ss_98a505de-a8f4-4d35-bcd3-968edd6d9ff5/serve-healthcheck-canary/0.log"
Jul 28 12:51:55.461098 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:55.461064    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bkxwz_b3d76279-c0b1-46d6-b8b5-3011de9ef2e4/migrator/0.log"
Jul 28 12:51:55.663005 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:55.662970    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bkxwz_b3d76279-c0b1-46d6-b8b5-3011de9ef2e4/graceful-termination/0.log"
Jul 28 12:51:56.188539 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:56.188478    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:56.814605 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:56.814561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk" event={"ID":"d3b2e8f3-960e-4dc6-b09f-ffb9b2f4a44b","Type":"ContainerStarted","Data":"7dde3022ed5c3c58511d40215752191f5f658c77d69f1c56ebb3056cd663064d"}
Jul 28 12:51:56.834629 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:56.834578    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-p2cqk" podStartSLOduration=2.584260565 podStartE2EDuration="4.834561904s" totalImagesPullingTime="2.250301339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:51:56.833703088 +0000 UTC m=+43.762987005" watchObservedRunningTime="2026-07-28 12:51:56.834561904 +0000 UTC m=+43.763845799"
Jul 28 12:51:57.098577 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:57.098478    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:57.684225 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:57.684187    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:57.821610 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:57.821577    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:57.922905 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:57.922859    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:58.028895 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:58.028853    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:58.129321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:58.129290    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:58.416801 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:58.416711    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:58.948181 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:58.948137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:58.948591 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:58.948314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:58.948591 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:58.948422    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:58.948591 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:51:58.948488    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls podName:6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896 nodeName:}" failed. No retries permitted until 2026-07-28 12:52:06.948471236 +0000 UTC m=+53.877755131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ssjr7" (UID: "6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896") : secret "insights-runtime-extractor-tls" not found
Jul 28 12:51:58.948711 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:58.948641    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:51:59.381155 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:59.381126    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:59.805397 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:59.805362    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:51:59.975479 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:51:59.975444    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:00.175029 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:00.174895    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:00.373356 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:00.373317    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:01.172478 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:01.172444    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:01.366331 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:01.366299    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:01.698875 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:01.698833    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:01.800100 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:01.800062    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:01.975992 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:01.975896    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:02.174365 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:02.174290    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:02.372962 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:02.372904    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:02.457236 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:02.457198    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:03.290226 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.290177    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:52:03.290612 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.290275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:52:03.292565 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.292521    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2900e2c5-02ba-4f9d-909a-85f7bc0dd0da-metrics-tls\") pod \"dns-default-56thl\" (UID: \"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da\") " pod="openshift-dns/dns-default-56thl"
Jul 28 12:52:03.292724 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.292703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls\") pod \"image-registry-76585448c6-qg77j\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") " pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:52:03.320723 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.320683    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-56thl"
Jul 28 12:52:03.329272 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.329253    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:52:03.441675 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.441639    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:03.487648 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.487532    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-56thl"]
Jul 28 12:52:03.491007 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:52:03.490974    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2900e2c5_02ba_4f9d_909a_85f7bc0dd0da.slice/crio-55018eaf59c897da42a9671788165b92589734ca18dd4bf1553532b77f4877ba WatchSource:0}: Error finding container 55018eaf59c897da42a9671788165b92589734ca18dd4bf1553532b77f4877ba: Status 404 returned error can't find the container with id 55018eaf59c897da42a9671788165b92589734ca18dd4bf1553532b77f4877ba
Jul 28 12:52:03.503142 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.503113    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76585448c6-qg77j"]
Jul 28 12:52:03.508761 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:52:03.508726    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093496a4_0e54_4910_9955_dcbba7e4d473.slice/crio-d378f797d4fd9842f88de576763586a6a07e7456b3c042eff59434604bde8d6c WatchSource:0}: Error finding container d378f797d4fd9842f88de576763586a6a07e7456b3c042eff59434604bde8d6c: Status 404 returned error can't find the container with id d378f797d4fd9842f88de576763586a6a07e7456b3c042eff59434604bde8d6c
Jul 28 12:52:03.778204 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.778157    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:03.833361 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.833258    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76585448c6-qg77j" event={"ID":"093496a4-0e54-4910-9955-dcbba7e4d473","Type":"ContainerStarted","Data":"7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a"}
Jul 28 12:52:03.833361 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.833314    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76585448c6-qg77j" event={"ID":"093496a4-0e54-4910-9955-dcbba7e4d473","Type":"ContainerStarted","Data":"d378f797d4fd9842f88de576763586a6a07e7456b3c042eff59434604bde8d6c"}
Jul 28 12:52:03.833594 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.833367    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:52:03.834476 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.834446    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56thl" event={"ID":"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da","Type":"ContainerStarted","Data":"55018eaf59c897da42a9671788165b92589734ca18dd4bf1553532b77f4877ba"}
Jul 28 12:52:03.861118 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.861061    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76585448c6-qg77j" podStartSLOduration=25.861043307 podStartE2EDuration="25.861043307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:03.860372707 +0000 UTC m=+50.789656626" watchObservedRunningTime="2026-07-28 12:52:03.861043307 +0000 UTC m=+50.790327202"
Jul 28 12:52:03.917821 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:03.917779    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:04.029987 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:04.029941    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:04.129563 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:04.129466    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:04.223510 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:04.223475    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:04.345222 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:04.345190    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:04.418550 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:04.418454    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:04.533490 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:04.533397    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:04.623936 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:04.623886    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:04.904119 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:04.904085    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:05.192338 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:05.192222    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:05.295259 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:05.295225    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:05.397698 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:05.397661    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:05.499001 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:05.498883    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:05.587280 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:05.587240    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:05.781565 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:05.781534    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:05.844267 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:05.844239    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56thl" event={"ID":"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da","Type":"ContainerStarted","Data":"33718a685e03fd191b5fceb7a4994524f03bb99106001a050d9f81d90949b517"}
Jul 28 12:52:05.915510 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:05.915475    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:06.132294 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:06.132205    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:06.227143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:06.227112    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:06.390741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:06.390651    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:06.787565 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:06.787531    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:06.849712 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:06.849682    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-56thl" event={"ID":"2900e2c5-02ba-4f9d-909a-85f7bc0dd0da","Type":"ContainerStarted","Data":"bce644301ac31c6bdb46ea99a84c89c35e79c16443ca7a3c6a087060850cb630"}
Jul 28 12:52:06.849888 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:06.849805    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-56thl"
Jul 28 12:52:06.873778 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:06.873730    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-56thl" podStartSLOduration=17.721975203 podStartE2EDuration="19.87371563s" totalImagesPullingTime="2.151740427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:06.872611867 +0000 UTC m=+53.801895810" watchObservedRunningTime="2026-07-28 12:52:06.87371563 +0000 UTC m=+53.802999546"
Jul 28 12:52:07.019582 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:07.019543    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:52:07.021806 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:07.021785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ssjr7\" (UID: \"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896\") " pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:52:07.056042 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:07.055966    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ssjr7"
Jul 28 12:52:07.190675 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:07.190618    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ssjr7"]
Jul 28 12:52:07.195017 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:52:07.194982    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2270ea_0a8d_4ac0_8b3a_41cde5fa9896.slice/crio-5ddaca41cb02a925a231c8e82a36d95c20d1008de3a5aecde936f9bc88d1b2a6 WatchSource:0}: Error finding container 5ddaca41cb02a925a231c8e82a36d95c20d1008de3a5aecde936f9bc88d1b2a6: Status 404 returned error can't find the container with id 5ddaca41cb02a925a231c8e82a36d95c20d1008de3a5aecde936f9bc88d1b2a6
Jul 28 12:52:07.197318 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:07.197293    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:07.381381 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:07.381286    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:07.814438 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:07.814392    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:07.856017 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:07.855972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ssjr7" event={"ID":"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896","Type":"ContainerStarted","Data":"5ddaca41cb02a925a231c8e82a36d95c20d1008de3a5aecde936f9bc88d1b2a6"}
Jul 28 12:52:08.202789 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:08.202615    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:08.575956 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:08.575909    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:08.725063 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:08.725016    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:08.823029 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:08.822994    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:12.875513 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:12.875476    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ssjr7" event={"ID":"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896","Type":"ContainerStarted","Data":"cec25a399faeca7ceef417d9f47c9adce7038b6d3e8c1fceb58b3da08f32738c"}
Jul 28 12:52:13.371140 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:13.371102    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:13.470982 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:13.470810    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:14.776151 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:14.776122    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f6dvd"
Jul 28 12:52:15.116842 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.116733    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"]
Jul 28 12:52:15.139838 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.139802    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"]
Jul 28 12:52:15.140019 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.139906    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"
Jul 28 12:52:15.144398 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.144295    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-h5pvp\""
Jul 28 12:52:15.144398 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.144367    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 12:52:15.144873 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.144852    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76585448c6-qg77j"]
Jul 28 12:52:15.145540 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.145057    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.147064 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.146889    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 28 12:52:15.147064 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.146939    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 12:52:15.148911 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.147533    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 12:52:15.148911 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.147786    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 28 12:52:15.148911 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.148528    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 28 12:52:15.148911 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.148700    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 28 12:52:15.148911 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.148738    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 28 12:52:15.148911 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.148799    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"]
Jul 28 12:52:15.149696 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.149674    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"]
Jul 28 12:52:15.160427 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.160395    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:15.182522 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.182492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.182522 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.182531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-ca\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.182741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.182564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/925cb063-91a3-4edf-ba2a-da0221aef611-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7497fd496b-wchqx\" (UID: \"925cb063-91a3-4edf-ba2a-da0221aef611\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"
Jul 28 12:52:15.182741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.182619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a14164e-845f-4496-93b5-6e238b859df6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.182741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.182703    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-hub\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.182864 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.182740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.182864 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.182777    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj6s8\" (UniqueName: \"kubernetes.io/projected/8a14164e-845f-4496-93b5-6e238b859df6-kube-api-access-hj6s8\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.182864 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.182793    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7g6d\" (UniqueName: \"kubernetes.io/projected/925cb063-91a3-4edf-ba2a-da0221aef611-kube-api-access-b7g6d\") pod \"managed-serviceaccount-addon-agent-7497fd496b-wchqx\" (UID: \"925cb063-91a3-4edf-ba2a-da0221aef611\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"
Jul 28 12:52:15.195029 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.194993    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f8df94fc5-vk8pj"]
Jul 28 12:52:15.200377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.200345    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.212640 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.212611    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f8df94fc5-vk8pj"]
Jul 28 12:52:15.276193 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.276153    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:15.283320 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283289    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1198a39e-11df-4cc6-a295-46e9dbd3f85e-installation-pull-secrets\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.283461 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283324    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1198a39e-11df-4cc6-a295-46e9dbd3f85e-image-registry-private-configuration\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.283461 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/925cb063-91a3-4edf-ba2a-da0221aef611-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7497fd496b-wchqx\" (UID: \"925cb063-91a3-4edf-ba2a-da0221aef611\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"
Jul 28 12:52:15.283461 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283416    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a14164e-845f-4496-93b5-6e238b859df6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.283461 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283445    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1198a39e-11df-4cc6-a295-46e9dbd3f85e-registry-certificates\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.283668 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283481    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5n55\" (UniqueName: \"kubernetes.io/projected/1198a39e-11df-4cc6-a295-46e9dbd3f85e-kube-api-access-p5n55\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.283668 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283513    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-hub\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.283668 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283561    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1198a39e-11df-4cc6-a295-46e9dbd3f85e-bound-sa-token\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.283668 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283640    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.283861 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1198a39e-11df-4cc6-a295-46e9dbd3f85e-ca-trust-extracted\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.283861 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283738    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1198a39e-11df-4cc6-a295-46e9dbd3f85e-registry-tls\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.283861 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283760    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1198a39e-11df-4cc6-a295-46e9dbd3f85e-trusted-ca\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.283861 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283789    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj6s8\" (UniqueName: \"kubernetes.io/projected/8a14164e-845f-4496-93b5-6e238b859df6-kube-api-access-hj6s8\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.283861 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283814    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7g6d\" (UniqueName: \"kubernetes.io/projected/925cb063-91a3-4edf-ba2a-da0221aef611-kube-api-access-b7g6d\") pod \"managed-serviceaccount-addon-agent-7497fd496b-wchqx\" (UID: \"925cb063-91a3-4edf-ba2a-da0221aef611\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"
Jul 28 12:52:15.284142 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.284142 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.283899    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-ca\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.285009 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.284985    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a14164e-845f-4496-93b5-6e238b859df6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.286409 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.286387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-hub\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.286551 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.286528    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/925cb063-91a3-4edf-ba2a-da0221aef611-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7497fd496b-wchqx\" (UID: \"925cb063-91a3-4edf-ba2a-da0221aef611\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"
Jul 28 12:52:15.286653 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.286631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.286765 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.286748    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-ca\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.287807 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.287784    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8a14164e-845f-4496-93b5-6e238b859df6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.298240 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.298213    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj6s8\" (UniqueName: \"kubernetes.io/projected/8a14164e-845f-4496-93b5-6e238b859df6-kube-api-access-hj6s8\") pod \"cluster-proxy-proxy-agent-68769c479d-dd4mg\" (UID: \"8a14164e-845f-4496-93b5-6e238b859df6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.299049 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.299031    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7g6d\" (UniqueName: \"kubernetes.io/projected/925cb063-91a3-4edf-ba2a-da0221aef611-kube-api-access-b7g6d\") pod \"managed-serviceaccount-addon-agent-7497fd496b-wchqx\" (UID: \"925cb063-91a3-4edf-ba2a-da0221aef611\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"
Jul 28 12:52:15.380016 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.379914    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:15.385544 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.385064    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1198a39e-11df-4cc6-a295-46e9dbd3f85e-installation-pull-secrets\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.385544 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.385108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1198a39e-11df-4cc6-a295-46e9dbd3f85e-image-registry-private-configuration\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.385544 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.385148    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1198a39e-11df-4cc6-a295-46e9dbd3f85e-registry-certificates\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.385544 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.385180    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5n55\" (UniqueName: \"kubernetes.io/projected/1198a39e-11df-4cc6-a295-46e9dbd3f85e-kube-api-access-p5n55\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.385544 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.385215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1198a39e-11df-4cc6-a295-46e9dbd3f85e-bound-sa-token\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.385544 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.385255    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1198a39e-11df-4cc6-a295-46e9dbd3f85e-ca-trust-extracted\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.385544 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.385299    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1198a39e-11df-4cc6-a295-46e9dbd3f85e-registry-tls\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.385544 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.385322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1198a39e-11df-4cc6-a295-46e9dbd3f85e-trusted-ca\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.386312 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.386285    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1198a39e-11df-4cc6-a295-46e9dbd3f85e-trusted-ca\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.386312 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.386297    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1198a39e-11df-4cc6-a295-46e9dbd3f85e-registry-certificates\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.386478 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.386281    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1198a39e-11df-4cc6-a295-46e9dbd3f85e-ca-trust-extracted\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.388516 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.388493    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1198a39e-11df-4cc6-a295-46e9dbd3f85e-installation-pull-secrets\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.388618 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.388566    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1198a39e-11df-4cc6-a295-46e9dbd3f85e-image-registry-private-configuration\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.388618 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.388581    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1198a39e-11df-4cc6-a295-46e9dbd3f85e-registry-tls\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.396100 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.396072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5n55\" (UniqueName: \"kubernetes.io/projected/1198a39e-11df-4cc6-a295-46e9dbd3f85e-kube-api-access-p5n55\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.397106 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.397083    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1198a39e-11df-4cc6-a295-46e9dbd3f85e-bound-sa-token\") pod \"image-registry-6f8df94fc5-vk8pj\" (UID: \"1198a39e-11df-4cc6-a295-46e9dbd3f85e\") " pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.470323 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.470288    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"
Jul 28 12:52:15.474504 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.474473    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"
Jul 28 12:52:15.479707 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.479674    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:15.528723 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.528680    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:15.599181 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.599148    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:15.728955 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.728830    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:15.812458 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:15.812409    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:16.146448 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.146427    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg"]
Jul 28 12:52:16.148743 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:52:16.148705    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a14164e_845f_4496_93b5_6e238b859df6.slice/crio-bb7d47ce1756ec439ff0617d97d23332b95cdbdbe3177424c88ea278072c48e4 WatchSource:0}: Error finding container bb7d47ce1756ec439ff0617d97d23332b95cdbdbe3177424c88ea278072c48e4: Status 404 returned error can't find the container with id bb7d47ce1756ec439ff0617d97d23332b95cdbdbe3177424c88ea278072c48e4
Jul 28 12:52:16.375796 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.375762    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx"]
Jul 28 12:52:16.378397 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.378370    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f8df94fc5-vk8pj"]
Jul 28 12:52:16.380294 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:52:16.380267    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod925cb063_91a3_4edf_ba2a_da0221aef611.slice/crio-dd1f56bcbc5d8706cfc23a2162589a898250be0af57ddd409378fc0889b2bedf WatchSource:0}: Error finding container dd1f56bcbc5d8706cfc23a2162589a898250be0af57ddd409378fc0889b2bedf: Status 404 returned error can't find the container with id dd1f56bcbc5d8706cfc23a2162589a898250be0af57ddd409378fc0889b2bedf
Jul 28 12:52:16.381098 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:52:16.381074    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1198a39e_11df_4cc6_a295_46e9dbd3f85e.slice/crio-e32b21d7d91e5f2636dadb514950f5ebef9ce1cf014b70d47d5361d449d3df24 WatchSource:0}: Error finding container e32b21d7d91e5f2636dadb514950f5ebef9ce1cf014b70d47d5361d449d3df24: Status 404 returned error can't find the container with id e32b21d7d91e5f2636dadb514950f5ebef9ce1cf014b70d47d5361d449d3df24
Jul 28 12:52:16.859237 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.859193    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-56thl"
Jul 28 12:52:16.895259 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.895149    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx" event={"ID":"925cb063-91a3-4edf-ba2a-da0221aef611","Type":"ContainerStarted","Data":"dd1f56bcbc5d8706cfc23a2162589a898250be0af57ddd409378fc0889b2bedf"}
Jul 28 12:52:16.896789 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.896753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg" event={"ID":"8a14164e-845f-4496-93b5-6e238b859df6","Type":"ContainerStarted","Data":"bb7d47ce1756ec439ff0617d97d23332b95cdbdbe3177424c88ea278072c48e4"}
Jul 28 12:52:16.899432 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.899392    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ssjr7" event={"ID":"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896","Type":"ContainerStarted","Data":"a5ce992eaa411ea3b7df2384c7413b74abc7bd106caf81816c312f534c5464a5"}
Jul 28 12:52:16.901204 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.901171    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj" event={"ID":"1198a39e-11df-4cc6-a295-46e9dbd3f85e","Type":"ContainerStarted","Data":"48da9b4905793f6c6004b00d4da16aa981b18938502076241bccb8a6834d54f3"}
Jul 28 12:52:16.901336 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.901224    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj" event={"ID":"1198a39e-11df-4cc6-a295-46e9dbd3f85e","Type":"ContainerStarted","Data":"e32b21d7d91e5f2636dadb514950f5ebef9ce1cf014b70d47d5361d449d3df24"}
Jul 28 12:52:16.901393 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.901332    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:16.930648 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:16.930349    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj" podStartSLOduration=1.930331699 podStartE2EDuration="1.930331699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:52:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:16.929461894 +0000 UTC m=+63.858745853" watchObservedRunningTime="2026-07-28 12:52:16.930331699 +0000 UTC m=+63.859615594"
Jul 28 12:52:18.314006 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.313525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:52:18.314006 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.313627    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:52:18.316776 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.316721    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 12:52:18.317699 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.317486    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 12:52:18.328160 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.328096    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a9e1925-e5c5-453a-943f-2c472b87cd2a-metrics-certs\") pod \"network-metrics-daemon-mnjqz\" (UID: \"8a9e1925-e5c5-453a-943f-2c472b87cd2a\") " pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:52:18.328968 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.328889    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e112889-b95e-488a-b6f7-4b30b5253836-original-pull-secret\") pod \"global-pull-secret-syncer-smsrp\" (UID: \"8e112889-b95e-488a-b6f7-4b30b5253836\") " pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:52:18.414609 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.414573    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smsrp"
Jul 28 12:52:18.414830 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.414799    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtnr\" (UniqueName: \"kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr\") pod \"network-check-target-g4qxs\" (UID: \"a5338cba-14a3-4e40-b1c3-3d9e2586cad7\") " pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:52:18.418184 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.418158    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 12:52:18.423076 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.422866    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n8x7n\""
Jul 28 12:52:18.428409 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.428383    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 12:52:18.430825 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.430637    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mnjqz"
Jul 28 12:52:18.440981 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.440913    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmtnr\" (UniqueName: \"kubernetes.io/projected/a5338cba-14a3-4e40-b1c3-3d9e2586cad7-kube-api-access-hmtnr\") pod \"network-check-target-g4qxs\" (UID: \"a5338cba-14a3-4e40-b1c3-3d9e2586cad7\") " pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:52:18.711679 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.711601    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lcpbt\""
Jul 28 12:52:18.719268 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:18.719237    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:52:21.754822 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:21.754732    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:21.868546 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:21.868507    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:22.001965 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.001905    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:22.110240 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.110192    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:22.190683 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.190597    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:22.278341 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.278304    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:22.377650 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.377574    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:22.591724 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.591697    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mnjqz"]
Jul 28 12:52:22.594849 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:52:22.594797    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9e1925_e5c5_453a_943f_2c472b87cd2a.slice/crio-1f03083df331ca2d48406bbaa4ac9443489da503f0a690bec8f1466b8bd84ec9 WatchSource:0}: Error finding container 1f03083df331ca2d48406bbaa4ac9443489da503f0a690bec8f1466b8bd84ec9: Status 404 returned error can't find the container with id 1f03083df331ca2d48406bbaa4ac9443489da503f0a690bec8f1466b8bd84ec9
Jul 28 12:52:22.613438 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.613393    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-smsrp"]
Jul 28 12:52:22.614550 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.614493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g4qxs"]
Jul 28 12:52:22.616265 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:52:22.616216    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5338cba_14a3_4e40_b1c3_3d9e2586cad7.slice/crio-cfe751d6c2b585fc0c4fa3c5bc4fd902783b3ded98f3d973a5bca39e28251469 WatchSource:0}: Error finding container cfe751d6c2b585fc0c4fa3c5bc4fd902783b3ded98f3d973a5bca39e28251469: Status 404 returned error can't find the container with id cfe751d6c2b585fc0c4fa3c5bc4fd902783b3ded98f3d973a5bca39e28251469
Jul 28 12:52:22.929460 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.929367    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx" event={"ID":"925cb063-91a3-4edf-ba2a-da0221aef611","Type":"ContainerStarted","Data":"0b2cd9b158944da468b0ac3ff1d69bb83474165421708fa38685f05ac18cf679"}
Jul 28 12:52:22.931370 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.931343    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg" event={"ID":"8a14164e-845f-4496-93b5-6e238b859df6","Type":"ContainerStarted","Data":"5c0f2c0e409615f3c76981bf9c36a2e3ab3456f14d587934f2b8d166a7fcaa47"}
Jul 28 12:52:22.931498 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.931379    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg" event={"ID":"8a14164e-845f-4496-93b5-6e238b859df6","Type":"ContainerStarted","Data":"731205dc027f9b99e808711613cdb0aac85401ade23273dce930e124909fde34"}
Jul 28 12:52:22.931498 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.931396    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg" event={"ID":"8a14164e-845f-4496-93b5-6e238b859df6","Type":"ContainerStarted","Data":"0bcce79696051437db42e976ade41f24d6ae1f528de886c8595c7c3aecbcb98d"}
Jul 28 12:52:22.933314 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.933287    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ssjr7" event={"ID":"6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896","Type":"ContainerStarted","Data":"b051f13d82157152dcceefa1b1db826359d3792067f3825cbaba4c47e9a0fb56"}
Jul 28 12:52:22.934487 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.934466    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mnjqz" event={"ID":"8a9e1925-e5c5-453a-943f-2c472b87cd2a","Type":"ContainerStarted","Data":"1f03083df331ca2d48406bbaa4ac9443489da503f0a690bec8f1466b8bd84ec9"}
Jul 28 12:52:22.935491 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.935471    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-smsrp" event={"ID":"8e112889-b95e-488a-b6f7-4b30b5253836","Type":"ContainerStarted","Data":"454a886ca4018900673b9979c1719d187379fbe263ff83ffbfc3df3fce5632f5"}
Jul 28 12:52:22.936416 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.936396    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g4qxs" event={"ID":"a5338cba-14a3-4e40-b1c3-3d9e2586cad7","Type":"ContainerStarted","Data":"cfe751d6c2b585fc0c4fa3c5bc4fd902783b3ded98f3d973a5bca39e28251469"}
Jul 28 12:52:22.950946 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.950262    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7497fd496b-wchqx" podStartSLOduration=1.940178347 podStartE2EDuration="7.950235605s" totalImagesPullingTime="6.010057258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:22.949371384 +0000 UTC m=+69.878655302" watchObservedRunningTime="2026-07-28 12:52:22.950235605 +0000 UTC m=+69.879519533"
Jul 28 12:52:22.973663 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:22.973610    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ssjr7" podStartSLOduration=16.970022702 podStartE2EDuration="31.973596759s" totalImagesPullingTime="15.003574057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:22.972653903 +0000 UTC m=+69.901937820" watchObservedRunningTime="2026-07-28 12:52:22.973596759 +0000 UTC m=+69.902880675"
Jul 28 12:52:23.004604 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:23.004551    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68769c479d-dd4mg" podStartSLOduration=1.744276797 podStartE2EDuration="8.004537873s" totalImagesPullingTime="6.260261076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:23.003975557 +0000 UTC m=+69.933259473" watchObservedRunningTime="2026-07-28 12:52:23.004537873 +0000 UTC m=+69.933821789"
Jul 28 12:52:23.736389 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:23.736286    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:23.813732 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:23.813546    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:24.371061 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:24.370962    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:24.554603 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:24.554527    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:24.633293 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:24.633201    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:24.833401 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:24.833362    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:24.936955 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:24.936848    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:24.945733 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:24.945699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mnjqz" event={"ID":"8a9e1925-e5c5-453a-943f-2c472b87cd2a","Type":"ContainerStarted","Data":"34d0e183d493a01dce873561471c4032431a62b6c11748571380f3825d3c42f1"}
Jul 28 12:52:24.945899 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:24.945759    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mnjqz" event={"ID":"8a9e1925-e5c5-453a-943f-2c472b87cd2a","Type":"ContainerStarted","Data":"70ec1888718129b50f7103c5ba6f072b59c8bbff4547e6e0f50a0ffb3eac6323"}
Jul 28 12:52:24.965547 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:24.965490    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mnjqz" podStartSLOduration=70.629243549 podStartE2EDuration="1m11.965471222s" totalImagesPullingTime="1.336227673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:24.96452501 +0000 UTC m=+71.893808939" watchObservedRunningTime="2026-07-28 12:52:24.965471222 +0000 UTC m=+71.894755138"
Jul 28 12:52:25.136639 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:25.136599    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:25.151622 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:25.151592    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:52:25.253495 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:25.253385    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:26.022503 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:26.022468    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:26.120252 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:26.120215    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:27.958914 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:27.958867    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-smsrp" event={"ID":"8e112889-b95e-488a-b6f7-4b30b5253836","Type":"ContainerStarted","Data":"eb5f2621f072a14a144d88ef6c1f7d51847fbec8c5ee13b9fa36361268075078"}
Jul 28 12:52:27.960337 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:27.960313    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g4qxs" event={"ID":"a5338cba-14a3-4e40-b1c3-3d9e2586cad7","Type":"ContainerStarted","Data":"f4adebcd5643f3a10eaddc908f39ed365ad8a8452e992fd794ffdffb917ffde1"}
Jul 28 12:52:27.960475 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:27.960370    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:52:27.977976 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:27.977913    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-smsrp" podStartSLOduration=70.29894687 podStartE2EDuration="1m14.977900852s" totalImagesPullingTime="4.678953982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:27.977068403 +0000 UTC m=+74.906352319" watchObservedRunningTime="2026-07-28 12:52:27.977900852 +0000 UTC m=+74.907184769"
Jul 28 12:52:27.995257 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:27.995216    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g4qxs" podStartSLOduration=70.31782302 podStartE2EDuration="1m14.995206583s" totalImagesPullingTime="4.677383563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:27.994247912 +0000 UTC m=+74.923531829" watchObservedRunningTime="2026-07-28 12:52:27.995206583 +0000 UTC m=+74.924490499"
Jul 28 12:52:28.778679 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:28.778640    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:28.857453 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:28.857416    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:29.030766 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:29.030685    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:29.131876 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:29.131840    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:29.279434 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:29.279399    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:31.005778 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:31.005740    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:31.242303 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:31.242259    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:31.341815 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:31.341778    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:32.475990 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:32.475952    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:32.768655 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:32.768619    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:32.878052 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:32.878017    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:33.950960 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:33.950913    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:34.054174 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.054140    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:34.247035 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.246938    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:34.445536 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.445497    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:34.572722 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.572672    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:34.652782 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.652742    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2qw89"]
Jul 28 12:52:34.658257 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.658225    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.664654 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.664626    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 12:52:34.664802 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.664753    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 12:52:34.665130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.665102    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 12:52:34.665330 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.665141    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nlpmr\""
Jul 28 12:52:34.665694 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.665679    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 12:52:34.666009 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.665986    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 12:52:34.666103 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.665998    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 12:52:34.691693 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.691660    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:34.748466 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.748430    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49e706ca-ba20-40b3-a0d5-9af3d30639aa-sys\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.748466 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.748461    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-tls\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.748631 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.748477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e706ca-ba20-40b3-a0d5-9af3d30639aa-metrics-client-ca\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.748631 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.748497    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-textfile\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.748631 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.748566    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-wtmp\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.748631 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.748598    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49e706ca-ba20-40b3-a0d5-9af3d30639aa-root\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.748777 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.748645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcqx2\" (UniqueName: \"kubernetes.io/projected/49e706ca-ba20-40b3-a0d5-9af3d30639aa-kube-api-access-hcqx2\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.748777 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.748672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.748777 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.748727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.786648 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.786612    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:34.849319 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849245    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49e706ca-ba20-40b3-a0d5-9af3d30639aa-root\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.849319 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcqx2\" (UniqueName: \"kubernetes.io/projected/49e706ca-ba20-40b3-a0d5-9af3d30639aa-kube-api-access-hcqx2\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.849506 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49e706ca-ba20-40b3-a0d5-9af3d30639aa-root\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.849506 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.849506 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849464    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.849665 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849644    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49e706ca-ba20-40b3-a0d5-9af3d30639aa-sys\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.849718 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849684    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-tls\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.849768 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e706ca-ba20-40b3-a0d5-9af3d30639aa-metrics-client-ca\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.849768 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849738    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49e706ca-ba20-40b3-a0d5-9af3d30639aa-sys\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.849768 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-textfile\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.849954 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.849898    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-wtmp\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.850120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.850094    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.850184 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.850098    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-wtmp\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.850239 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.850213    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-textfile\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.850385 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.850364    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e706ca-ba20-40b3-a0d5-9af3d30639aa-metrics-client-ca\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.851988 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.851960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-tls\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.852084 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.851989    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49e706ca-ba20-40b3-a0d5-9af3d30639aa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.865821 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.865797    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcqx2\" (UniqueName: \"kubernetes.io/projected/49e706ca-ba20-40b3-a0d5-9af3d30639aa-kube-api-access-hcqx2\") pod \"node-exporter-2qw89\" (UID: \"49e706ca-ba20-40b3-a0d5-9af3d30639aa\") " pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.888687 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.888658    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:34.969358 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:34.969322    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2qw89"
Jul 28 12:52:34.984186 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:52:34.984156    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e706ca_ba20_40b3_a0d5_9af3d30639aa.slice/crio-ababbdb41855f69111e1d2f5b757034bea1cc29bc1c79edffd9a3a3ea8e886b6 WatchSource:0}: Error finding container ababbdb41855f69111e1d2f5b757034bea1cc29bc1c79edffd9a3a3ea8e886b6: Status 404 returned error can't find the container with id ababbdb41855f69111e1d2f5b757034bea1cc29bc1c79edffd9a3a3ea8e886b6
Jul 28 12:52:35.110723 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:35.110577    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:35.242745 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:35.242693    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:35.590231 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:35.590102    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:35.826372 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:35.826339    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:35.920618 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:35.920587    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:35.989640 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:35.989612    2567 generic.go:356] "Generic (PLEG): container finished" podID="49e706ca-ba20-40b3-a0d5-9af3d30639aa" containerID="cf645e808ae93d4f10a668097e9c43c9f61f1f35d73ffaa5921ede39913ad91b" exitCode=0
Jul 28 12:52:35.990110 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:35.989657    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qw89" event={"ID":"49e706ca-ba20-40b3-a0d5-9af3d30639aa","Type":"ContainerDied","Data":"cf645e808ae93d4f10a668097e9c43c9f61f1f35d73ffaa5921ede39913ad91b"}
Jul 28 12:52:35.990110 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:35.989715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qw89" event={"ID":"49e706ca-ba20-40b3-a0d5-9af3d30639aa","Type":"ContainerStarted","Data":"ababbdb41855f69111e1d2f5b757034bea1cc29bc1c79edffd9a3a3ea8e886b6"}
Jul 28 12:52:36.211482 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:36.211450    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:36.310885 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:36.310849    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:36.995589 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:36.995557    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qw89" event={"ID":"49e706ca-ba20-40b3-a0d5-9af3d30639aa","Type":"ContainerStarted","Data":"e822bb33f336d0f0addcc30c12103203aba9b10a24b9d8c84eb72a8732de25c3"}
Jul 28 12:52:36.996038 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:36.995610    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qw89" event={"ID":"49e706ca-ba20-40b3-a0d5-9af3d30639aa","Type":"ContainerStarted","Data":"aad122ba5e6ef278f3e61d16cbabeb1f43ab057032587da91a8a8d9a1c5384ab"}
Jul 28 12:52:37.021198 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:37.021143    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2qw89" podStartSLOduration=2.106772185 podStartE2EDuration="3.02112408s" totalImagesPullingTime="849.80116ms" totalInitContainerRuntime="64.550735ms" isStatefulPod=true podCreationTimestamp="2026-07-28 12:52:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:52:37.020663812 +0000 UTC m=+83.949947754" watchObservedRunningTime="2026-07-28 12:52:37.02112408 +0000 UTC m=+83.950407996"
Jul 28 12:52:37.563590 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:37.563531    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:37.645341 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:37.645309    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:37.774216 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:37.774182    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:37.874432 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:37.874344    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:37.912551 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:37.912526    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f8df94fc5-vk8pj"
Jul 28 12:52:38.069432 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:38.069393    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:38.165057 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:38.164969    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:39.281883 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:39.281851    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:39.381634 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:39.381603    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:39.479422 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:39.479370    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:39.550750 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:39.550655    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:39.884676 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:39.884586    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:39.958203 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:39.958167    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:40.167379 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.167290    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76585448c6-qg77j" podUID="093496a4-0e54-4910-9955-dcbba7e4d473" containerName="registry" containerID="cri-o://7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a" gracePeriod=30
Jul 28 12:52:40.263701 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.263667    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:40.335558 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.335526    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:40.422629 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.422565    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:52:40.490793 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.490756    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-image-registry-private-configuration\") pod \"093496a4-0e54-4910-9955-dcbba7e4d473\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") "
Jul 28 12:52:40.490793 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.490797    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-bound-sa-token\") pod \"093496a4-0e54-4910-9955-dcbba7e4d473\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") "
Jul 28 12:52:40.491097 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.490840    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls\") pod \"093496a4-0e54-4910-9955-dcbba7e4d473\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") "
Jul 28 12:52:40.491097 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.490869    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-trusted-ca\") pod \"093496a4-0e54-4910-9955-dcbba7e4d473\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") "
Jul 28 12:52:40.491097 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.490903    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-installation-pull-secrets\") pod \"093496a4-0e54-4910-9955-dcbba7e4d473\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") "
Jul 28 12:52:40.491097 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.490956    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz544\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-kube-api-access-bz544\") pod \"093496a4-0e54-4910-9955-dcbba7e4d473\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") "
Jul 28 12:52:40.491097 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.490996    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/093496a4-0e54-4910-9955-dcbba7e4d473-ca-trust-extracted\") pod \"093496a4-0e54-4910-9955-dcbba7e4d473\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") "
Jul 28 12:52:40.491097 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.491019    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-registry-certificates\") pod \"093496a4-0e54-4910-9955-dcbba7e4d473\" (UID: \"093496a4-0e54-4910-9955-dcbba7e4d473\") "
Jul 28 12:52:40.491682 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.491596    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "093496a4-0e54-4910-9955-dcbba7e4d473" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:52:40.491682 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.491641    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "093496a4-0e54-4910-9955-dcbba7e4d473" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:52:40.493497 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.493468    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "093496a4-0e54-4910-9955-dcbba7e4d473" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:52:40.493602 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.493496    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "093496a4-0e54-4910-9955-dcbba7e4d473" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:52:40.493602 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.493560    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "093496a4-0e54-4910-9955-dcbba7e4d473" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:52:40.493749 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.493731    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-kube-api-access-bz544" (OuterVolumeSpecName: "kube-api-access-bz544") pod "093496a4-0e54-4910-9955-dcbba7e4d473" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473"). InnerVolumeSpecName "kube-api-access-bz544". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:52:40.493785 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.493744    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "093496a4-0e54-4910-9955-dcbba7e4d473" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:52:40.500133 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.500106    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/093496a4-0e54-4910-9955-dcbba7e4d473-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "093496a4-0e54-4910-9955-dcbba7e4d473" (UID: "093496a4-0e54-4910-9955-dcbba7e4d473"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:52:40.592360 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.592320    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-installation-pull-secrets\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:52:40.592360 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.592352    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz544\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-kube-api-access-bz544\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:52:40.592360 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.592362    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/093496a4-0e54-4910-9955-dcbba7e4d473-ca-trust-extracted\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:52:40.592360 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.592371    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-registry-certificates\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:52:40.592618 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.592380    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/093496a4-0e54-4910-9955-dcbba7e4d473-image-registry-private-configuration\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:52:40.592618 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.592389    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-bound-sa-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:52:40.592618 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.592398    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/093496a4-0e54-4910-9955-dcbba7e4d473-registry-tls\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:52:40.592618 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.592405    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/093496a4-0e54-4910-9955-dcbba7e4d473-trusted-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:52:40.888861 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:40.888826    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:41.009800 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.009761    2567 generic.go:356] "Generic (PLEG): container finished" podID="093496a4-0e54-4910-9955-dcbba7e4d473" containerID="7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a" exitCode=0
Jul 28 12:52:41.009986 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.009809    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76585448c6-qg77j"
Jul 28 12:52:41.009986 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.009811    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76585448c6-qg77j" event={"ID":"093496a4-0e54-4910-9955-dcbba7e4d473","Type":"ContainerDied","Data":"7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a"}
Jul 28 12:52:41.009986 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.009950    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76585448c6-qg77j" event={"ID":"093496a4-0e54-4910-9955-dcbba7e4d473","Type":"ContainerDied","Data":"d378f797d4fd9842f88de576763586a6a07e7456b3c042eff59434604bde8d6c"}
Jul 28 12:52:41.009986 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.009983    2567 scope.go:117] "RemoveContainer" containerID="7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a"
Jul 28 12:52:41.019073 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.019055    2567 scope.go:117] "RemoveContainer" containerID="7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a"
Jul 28 12:52:41.019344 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:52:41.019323    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a\": container with ID starting with 7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a not found: ID does not exist" containerID="7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a"
Jul 28 12:52:41.019414 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.019357    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a"} err="failed to get container status \"7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a\": rpc error: code = NotFound desc = could not find container \"7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a\": container with ID starting with 7833cfd46d8d97e983342b9486e8c6e55b1dbb808f8efe965c63c1cb85f51b7a not found: ID does not exist"
Jul 28 12:52:41.045528 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.045495    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76585448c6-qg77j"]
Jul 28 12:52:41.054195 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.054095    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76585448c6-qg77j"]
Jul 28 12:52:41.072964 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.072934    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:41.221545 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.221455    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:41.499655 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:41.499577    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="093496a4-0e54-4910-9955-dcbba7e4d473" path="/var/lib/kubelet/pods/093496a4-0e54-4910-9955-dcbba7e4d473/volumes"
Jul 28 12:52:44.215953 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:44.215902    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:44.334684 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:44.334637    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:50.265469 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:50.265428    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:50.353304 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:50.353269    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:53.841348 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:53.841312    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:53.941020 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:53.940987    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:52:58.966344 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:52:58.966306    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g4qxs"
Jul 28 12:53:01.977276 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:53:01.977238    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:53:02.050147 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:53:02.050102    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:53:07.965207 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:53:07.965171    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:53:08.042653 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:53:08.042615    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:53:08.762531 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:53:08.762490    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:53:08.863103 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:53:08.863065    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:53:53.929947 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:53:53.929891    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:53:54.273291 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:53:54.273258    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:53:59.625826 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:53:59.625786    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:53:59.727218 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:53:59.727179    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:04.333109 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:04.333064    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:04.401811 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:04.401773    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:09.252280 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:09.252201    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:09.354106 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:09.354063    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:21.294465 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:21.294426    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:21.362538 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:21.362496    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:21.602768 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:21.602676    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:21.703744 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:21.703712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:21.767579 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:21.767549    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:23.721892 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:23.721853    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:23.795514 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:23.795474    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:31.829086 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:31.829041    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:31.900340 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:31.900299    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:35.552200 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:35.552162    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:35.633331 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:35.633304    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:38.740347 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:38.740310    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:54:38.844744 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:54:38.844710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:55:09.933143 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:55:09.933100    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:55:10.028986 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:55:10.028909    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:13.412036 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:13.412008    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 12:56:14.035035 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.034992    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"]
Jul 28 12:56:14.037226 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.035287    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="093496a4-0e54-4910-9955-dcbba7e4d473" containerName="registry"
Jul 28 12:56:14.037226 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.035300    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="093496a4-0e54-4910-9955-dcbba7e4d473" containerName="registry"
Jul 28 12:56:14.037226 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.035342    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="093496a4-0e54-4910-9955-dcbba7e4d473" containerName="registry"
Jul 28 12:56:14.038130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.038111    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.040992 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.040972    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bkg28\""
Jul 28 12:56:14.041098 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.040972    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 12:56:14.042021 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.042005    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 12:56:14.052236 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.052212    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"]
Jul 28 12:56:14.057382 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.057360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.057504 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.057393    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.057504 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.057437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tnvp\" (UniqueName: \"kubernetes.io/projected/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-kube-api-access-5tnvp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.157901 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.157871    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tnvp\" (UniqueName: \"kubernetes.io/projected/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-kube-api-access-5tnvp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.158107 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.157940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.158107 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.157963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.158291 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.158273    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.158346 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.158328    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.167961 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.167912    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tnvp\" (UniqueName: \"kubernetes.io/projected/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-kube-api-access-5tnvp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.347108 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.347003    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:14.479433 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.479399    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"]
Jul 28 12:56:14.482331 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:56:14.482300    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254d9a4d_f32d_4db0_9ddf_d2a12fb44d25.slice/crio-c8fd596e6f7845cdbe5224aa90f0231655944a4f1de83f8f2d531bb4d299c624 WatchSource:0}: Error finding container c8fd596e6f7845cdbe5224aa90f0231655944a4f1de83f8f2d531bb4d299c624: Status 404 returned error can't find the container with id c8fd596e6f7845cdbe5224aa90f0231655944a4f1de83f8f2d531bb4d299c624
Jul 28 12:56:14.484390 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.484372    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 12:56:14.695414 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:14.695321    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452" event={"ID":"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25","Type":"ContainerStarted","Data":"c8fd596e6f7845cdbe5224aa90f0231655944a4f1de83f8f2d531bb4d299c624"}
Jul 28 12:56:21.720971 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:21.720869    2567 generic.go:356] "Generic (PLEG): container finished" podID="254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" containerID="ee08cfad568d1d1cf76d0f706ae6569ecd9dad244668f9e7352aed19f2d9acf1" exitCode=0
Jul 28 12:56:21.721367 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:21.720972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452" event={"ID":"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25","Type":"ContainerDied","Data":"ee08cfad568d1d1cf76d0f706ae6569ecd9dad244668f9e7352aed19f2d9acf1"}
Jul 28 12:56:24.735030 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:24.734991    2567 generic.go:356] "Generic (PLEG): container finished" podID="254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" containerID="de1b3cc325248eb7f6c694b56ab05952bf42fe6e339caa5bc13c7168171afffa" exitCode=0
Jul 28 12:56:24.735456 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:24.735083    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452" event={"ID":"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25","Type":"ContainerDied","Data":"de1b3cc325248eb7f6c694b56ab05952bf42fe6e339caa5bc13c7168171afffa"}
Jul 28 12:56:31.762802 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:31.762765    2567 generic.go:356] "Generic (PLEG): container finished" podID="254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" containerID="a853a824987bb73b3bb3b7d1cb71e35d1d22329d9e23bbe5db15905fff4b8d65" exitCode=0
Jul 28 12:56:31.763341 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:31.762812    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452" event={"ID":"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25","Type":"ContainerDied","Data":"a853a824987bb73b3bb3b7d1cb71e35d1d22329d9e23bbe5db15905fff4b8d65"}
Jul 28 12:56:32.886284 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:32.886252    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:32.981883 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:32.981852    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tnvp\" (UniqueName: \"kubernetes.io/projected/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-kube-api-access-5tnvp\") pod \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") "
Jul 28 12:56:32.982102 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:32.981898    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-bundle\") pod \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") "
Jul 28 12:56:32.982102 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:32.981948    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-util\") pod \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\" (UID: \"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25\") "
Jul 28 12:56:32.982620 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:32.982591    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-bundle" (OuterVolumeSpecName: "bundle") pod "254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" (UID: "254d9a4d-f32d-4db0-9ddf-d2a12fb44d25"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:56:32.984089 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:32.984059    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-kube-api-access-5tnvp" (OuterVolumeSpecName: "kube-api-access-5tnvp") pod "254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" (UID: "254d9a4d-f32d-4db0-9ddf-d2a12fb44d25"). InnerVolumeSpecName "kube-api-access-5tnvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:56:32.986372 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:32.986349    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-util" (OuterVolumeSpecName: "util") pod "254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" (UID: "254d9a4d-f32d-4db0-9ddf-d2a12fb44d25"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:56:33.082568 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:33.082481    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tnvp\" (UniqueName: \"kubernetes.io/projected/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-kube-api-access-5tnvp\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:56:33.082568 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:33.082512    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:56:33.082568 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:33.082521    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/254d9a4d-f32d-4db0-9ddf-d2a12fb44d25-util\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:56:33.772347 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:33.772309    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452" event={"ID":"254d9a4d-f32d-4db0-9ddf-d2a12fb44d25","Type":"ContainerDied","Data":"c8fd596e6f7845cdbe5224aa90f0231655944a4f1de83f8f2d531bb4d299c624"}
Jul 28 12:56:33.772347 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:33.772336    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zf452"
Jul 28 12:56:33.772543 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:33.772361    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8fd596e6f7845cdbe5224aa90f0231655944a4f1de83f8f2d531bb4d299c624"
Jul 28 12:56:35.376683 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:35.376644    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:36.784937 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:36.784883    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:37.400373 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.400341    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"]
Jul 28 12:56:37.400602 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.400590    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" containerName="pull"
Jul 28 12:56:37.400641 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.400604    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" containerName="pull"
Jul 28 12:56:37.400641 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.400619    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" containerName="util"
Jul 28 12:56:37.400641 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.400625    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" containerName="util"
Jul 28 12:56:37.400641 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.400631    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" containerName="extract"
Jul 28 12:56:37.400641 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.400636    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" containerName="extract"
Jul 28 12:56:37.400791 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.400672    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="254d9a4d-f32d-4db0-9ddf-d2a12fb44d25" containerName="extract"
Jul 28 12:56:37.403431 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.403414    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"
Jul 28 12:56:37.407418 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.407399    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 28 12:56:37.407540 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.407453    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:56:37.407614 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.407592    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7z8pb\""
Jul 28 12:56:37.409808 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.409471    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfs6f\" (UniqueName: \"kubernetes.io/projected/6129a3f7-90ed-4e2d-9179-d4f55916b9fc-kube-api-access-mfs6f\") pod \"cert-manager-operator-controller-manager-55c444bf86-2qtjm\" (UID: \"6129a3f7-90ed-4e2d-9179-d4f55916b9fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"
Jul 28 12:56:37.409808 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.409533    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6129a3f7-90ed-4e2d-9179-d4f55916b9fc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2qtjm\" (UID: \"6129a3f7-90ed-4e2d-9179-d4f55916b9fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"
Jul 28 12:56:37.420194 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.420167    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"]
Jul 28 12:56:37.510561 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.510527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6129a3f7-90ed-4e2d-9179-d4f55916b9fc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2qtjm\" (UID: \"6129a3f7-90ed-4e2d-9179-d4f55916b9fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"
Jul 28 12:56:37.510733 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.510578    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfs6f\" (UniqueName: \"kubernetes.io/projected/6129a3f7-90ed-4e2d-9179-d4f55916b9fc-kube-api-access-mfs6f\") pod \"cert-manager-operator-controller-manager-55c444bf86-2qtjm\" (UID: \"6129a3f7-90ed-4e2d-9179-d4f55916b9fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"
Jul 28 12:56:37.510870 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.510852    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6129a3f7-90ed-4e2d-9179-d4f55916b9fc-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2qtjm\" (UID: \"6129a3f7-90ed-4e2d-9179-d4f55916b9fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"
Jul 28 12:56:37.525500 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.525474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfs6f\" (UniqueName: \"kubernetes.io/projected/6129a3f7-90ed-4e2d-9179-d4f55916b9fc-kube-api-access-mfs6f\") pod \"cert-manager-operator-controller-manager-55c444bf86-2qtjm\" (UID: \"6129a3f7-90ed-4e2d-9179-d4f55916b9fc\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"
Jul 28 12:56:37.712642 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.712544    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"
Jul 28 12:56:37.869303 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:37.869265    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm"]
Jul 28 12:56:37.872242 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:56:37.872216    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6129a3f7_90ed_4e2d_9179_d4f55916b9fc.slice/crio-8b032681f94a11861d05babdec745b11f81c837530c142d6399296b87c694b18 WatchSource:0}: Error finding container 8b032681f94a11861d05babdec745b11f81c837530c142d6399296b87c694b18: Status 404 returned error can't find the container with id 8b032681f94a11861d05babdec745b11f81c837530c142d6399296b87c694b18
Jul 28 12:56:38.791189 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:38.791149    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm" event={"ID":"6129a3f7-90ed-4e2d-9179-d4f55916b9fc","Type":"ContainerStarted","Data":"8b032681f94a11861d05babdec745b11f81c837530c142d6399296b87c694b18"}
Jul 28 12:56:39.344371 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:39.344328    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:39.449041 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:39.449004    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:41.543474 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:41.543437    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:41.642387 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:41.642349    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:41.802950 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:41.802846    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm" event={"ID":"6129a3f7-90ed-4e2d-9179-d4f55916b9fc","Type":"ContainerStarted","Data":"65121c7652de406910cde67874100fcb8f5eae73d67859b11c8df44c9d796ae6"}
Jul 28 12:56:41.826584 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:41.826537    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2qtjm" podStartSLOduration=1.847824604 podStartE2EDuration="4.826522784s" totalImagesPullingTime="2.97869818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:56:41.825974908 +0000 UTC m=+328.755258824" watchObservedRunningTime="2026-07-28 12:56:41.826522784 +0000 UTC m=+328.755806700"
Jul 28 12:56:42.252214 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.252120    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:42.362808 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.362767    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:42.442833 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.442797    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"]
Jul 28 12:56:42.446229 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.446208    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.463854 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.463823    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bkg28\""
Jul 28 12:56:42.464326 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.464312    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 12:56:42.464439 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.464424    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 12:56:42.480965 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.480936    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"]
Jul 28 12:56:42.541981 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.541913    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.542183 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.541990    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.542183 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.542020    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56nzx\" (UniqueName: \"kubernetes.io/projected/a39d87ee-7b0d-4c0a-9905-886301241816-kube-api-access-56nzx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.642500 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.642469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.643012 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.642508    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.643012 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.642531    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56nzx\" (UniqueName: \"kubernetes.io/projected/a39d87ee-7b0d-4c0a-9905-886301241816-kube-api-access-56nzx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.643012 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.642862    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.643012 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.642957    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.665081 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.665046    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56nzx\" (UniqueName: \"kubernetes.io/projected/a39d87ee-7b0d-4c0a-9905-886301241816-kube-api-access-56nzx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.755144 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.755102    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:42.890163 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:42.890127    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"]
Jul 28 12:56:42.895004 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:56:42.894972    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39d87ee_7b0d_4c0a_9905_886301241816.slice/crio-ebc3d21d81da8531a1e29608eea1f33981a470c737314faf5f9dc4a68b5b68c3 WatchSource:0}: Error finding container ebc3d21d81da8531a1e29608eea1f33981a470c737314faf5f9dc4a68b5b68c3: Status 404 returned error can't find the container with id ebc3d21d81da8531a1e29608eea1f33981a470c737314faf5f9dc4a68b5b68c3
Jul 28 12:56:43.812237 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:43.812200    2567 generic.go:356] "Generic (PLEG): container finished" podID="a39d87ee-7b0d-4c0a-9905-886301241816" containerID="e6e1066c0ec85483de64b4df888bd231c37bcd63d6400181a81108f0534338e6" exitCode=0
Jul 28 12:56:43.812725 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:43.812273    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7" event={"ID":"a39d87ee-7b0d-4c0a-9905-886301241816","Type":"ContainerDied","Data":"e6e1066c0ec85483de64b4df888bd231c37bcd63d6400181a81108f0534338e6"}
Jul 28 12:56:43.812725 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:43.812323    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7" event={"ID":"a39d87ee-7b0d-4c0a-9905-886301241816","Type":"ContainerStarted","Data":"ebc3d21d81da8531a1e29608eea1f33981a470c737314faf5f9dc4a68b5b68c3"}
Jul 28 12:56:43.894744 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:43.894707    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:44.102890 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:44.102854    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:45.730787 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:45.730730    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:45.832305 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:45.832267    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:46.826874 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:46.826836    2567 generic.go:356] "Generic (PLEG): container finished" podID="a39d87ee-7b0d-4c0a-9905-886301241816" containerID="d1fad4e39a906d59fa79ecaedc5e59c8774bdcf1c0f62fb8166c8bb7351c4b63" exitCode=0
Jul 28 12:56:46.827272 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:46.826905    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7" event={"ID":"a39d87ee-7b0d-4c0a-9905-886301241816","Type":"ContainerDied","Data":"d1fad4e39a906d59fa79ecaedc5e59c8774bdcf1c0f62fb8166c8bb7351c4b63"}
Jul 28 12:56:47.832317 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:47.832274    2567 generic.go:356] "Generic (PLEG): container finished" podID="a39d87ee-7b0d-4c0a-9905-886301241816" containerID="f58802a22481a86034d8aa2c6665dc4ae5783160cea0e1d1e3101f72b67a6acc" exitCode=0
Jul 28 12:56:47.832710 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:47.832364    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7" event={"ID":"a39d87ee-7b0d-4c0a-9905-886301241816","Type":"ContainerDied","Data":"f58802a22481a86034d8aa2c6665dc4ae5783160cea0e1d1e3101f72b67a6acc"}
Jul 28 12:56:48.957016 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:48.956989    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:48.983795 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:48.983761    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56nzx\" (UniqueName: \"kubernetes.io/projected/a39d87ee-7b0d-4c0a-9905-886301241816-kube-api-access-56nzx\") pod \"a39d87ee-7b0d-4c0a-9905-886301241816\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") "
Jul 28 12:56:48.983974 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:48.983839    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-util\") pod \"a39d87ee-7b0d-4c0a-9905-886301241816\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") "
Jul 28 12:56:48.983974 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:48.983888    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-bundle\") pod \"a39d87ee-7b0d-4c0a-9905-886301241816\" (UID: \"a39d87ee-7b0d-4c0a-9905-886301241816\") "
Jul 28 12:56:48.984272 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:48.984242    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-bundle" (OuterVolumeSpecName: "bundle") pod "a39d87ee-7b0d-4c0a-9905-886301241816" (UID: "a39d87ee-7b0d-4c0a-9905-886301241816"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:56:48.986104 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:48.986077    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39d87ee-7b0d-4c0a-9905-886301241816-kube-api-access-56nzx" (OuterVolumeSpecName: "kube-api-access-56nzx") pod "a39d87ee-7b0d-4c0a-9905-886301241816" (UID: "a39d87ee-7b0d-4c0a-9905-886301241816"). InnerVolumeSpecName "kube-api-access-56nzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:56:48.988492 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:48.988465    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-util" (OuterVolumeSpecName: "util") pod "a39d87ee-7b0d-4c0a-9905-886301241816" (UID: "a39d87ee-7b0d-4c0a-9905-886301241816"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:56:49.084541 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:49.084487    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-util\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:56:49.084541 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:49.084534    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a39d87ee-7b0d-4c0a-9905-886301241816-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:56:49.084541 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:49.084546    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56nzx\" (UniqueName: \"kubernetes.io/projected/a39d87ee-7b0d-4c0a-9905-886301241816-kube-api-access-56nzx\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:56:49.840847 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:49.840816    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7"
Jul 28 12:56:49.840847 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:49.840825    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6hbl7" event={"ID":"a39d87ee-7b0d-4c0a-9905-886301241816","Type":"ContainerDied","Data":"ebc3d21d81da8531a1e29608eea1f33981a470c737314faf5f9dc4a68b5b68c3"}
Jul 28 12:56:49.841069 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:49.840893    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebc3d21d81da8531a1e29608eea1f33981a470c737314faf5f9dc4a68b5b68c3"
Jul 28 12:56:51.079870 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:51.079835    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:56.762148 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:56.762113    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:56.866932 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:56.866897    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:58.855272 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.855238    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"]
Jul 28 12:56:58.855665 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.855479    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39d87ee-7b0d-4c0a-9905-886301241816" containerName="pull"
Jul 28 12:56:58.855665 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.855489    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39d87ee-7b0d-4c0a-9905-886301241816" containerName="pull"
Jul 28 12:56:58.855665 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.855497    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39d87ee-7b0d-4c0a-9905-886301241816" containerName="extract"
Jul 28 12:56:58.855665 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.855503    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39d87ee-7b0d-4c0a-9905-886301241816" containerName="extract"
Jul 28 12:56:58.855665 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.855515    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39d87ee-7b0d-4c0a-9905-886301241816" containerName="util"
Jul 28 12:56:58.855665 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.855521    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39d87ee-7b0d-4c0a-9905-886301241816" containerName="util"
Jul 28 12:56:58.855665 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.855564    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a39d87ee-7b0d-4c0a-9905-886301241816" containerName="extract"
Jul 28 12:56:58.860399 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.860375    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"
Jul 28 12:56:58.864358 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.864332    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 12:56:58.865369 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.865330    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 12:56:58.865642 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.865451    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-b29lc\""
Jul 28 12:56:58.870571 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.870549    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"]
Jul 28 12:56:58.960144 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.960109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2597afe-0b52-4b32-8840-d382b1b52b90-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w95p6\" (UID: \"b2597afe-0b52-4b32-8840-d382b1b52b90\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"
Jul 28 12:56:58.960337 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:58.960175    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57kxp\" (UniqueName: \"kubernetes.io/projected/b2597afe-0b52-4b32-8840-d382b1b52b90-kube-api-access-57kxp\") pod \"openshift-lws-operator-fd8ccff4c-w95p6\" (UID: \"b2597afe-0b52-4b32-8840-d382b1b52b90\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"
Jul 28 12:56:59.061308 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:59.061268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2597afe-0b52-4b32-8840-d382b1b52b90-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w95p6\" (UID: \"b2597afe-0b52-4b32-8840-d382b1b52b90\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"
Jul 28 12:56:59.061483 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:59.061344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57kxp\" (UniqueName: \"kubernetes.io/projected/b2597afe-0b52-4b32-8840-d382b1b52b90-kube-api-access-57kxp\") pod \"openshift-lws-operator-fd8ccff4c-w95p6\" (UID: \"b2597afe-0b52-4b32-8840-d382b1b52b90\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"
Jul 28 12:56:59.061661 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:59.061640    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2597afe-0b52-4b32-8840-d382b1b52b90-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w95p6\" (UID: \"b2597afe-0b52-4b32-8840-d382b1b52b90\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"
Jul 28 12:56:59.075762 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:59.075725    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57kxp\" (UniqueName: \"kubernetes.io/projected/b2597afe-0b52-4b32-8840-d382b1b52b90-kube-api-access-57kxp\") pod \"openshift-lws-operator-fd8ccff4c-w95p6\" (UID: \"b2597afe-0b52-4b32-8840-d382b1b52b90\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"
Jul 28 12:56:59.169598 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:59.169525    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"
Jul 28 12:56:59.299768 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:59.299742    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6"]
Jul 28 12:56:59.302459 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:56:59.302426    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2597afe_0b52_4b32_8840_d382b1b52b90.slice/crio-e789afde67d2eafc8fd05533ef2c1eae9aa612cb4e0d89857553e342276c6273 WatchSource:0}: Error finding container e789afde67d2eafc8fd05533ef2c1eae9aa612cb4e0d89857553e342276c6273: Status 404 returned error can't find the container with id e789afde67d2eafc8fd05533ef2c1eae9aa612cb4e0d89857553e342276c6273
Jul 28 12:56:59.343217 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:59.343169    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:56:59.879940 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:56:59.879887    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6" event={"ID":"b2597afe-0b52-4b32-8840-d382b1b52b90","Type":"ContainerStarted","Data":"e789afde67d2eafc8fd05533ef2c1eae9aa612cb4e0d89857553e342276c6273"}
Jul 28 12:57:01.889971 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:01.889864    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6" event={"ID":"b2597afe-0b52-4b32-8840-d382b1b52b90","Type":"ContainerStarted","Data":"7176b69a3a6dc358f31b67b7fbe0102772311ed773aaf70d6a2f587b8e64eae7"}
Jul 28 12:57:01.909516 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:01.909465    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w95p6" podStartSLOduration=1.581234103 podStartE2EDuration="3.909447189s" totalImagesPullingTime="2.328213086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:57:01.908506357 +0000 UTC m=+348.837790275" watchObservedRunningTime="2026-07-28 12:57:01.909447189 +0000 UTC m=+348.838731105"
Jul 28 12:57:02.806810 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:02.806760    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:02.906504 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:02.906454    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:05.100618 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:05.100509    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:07.523126 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.523090    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"]
Jul 28 12:57:07.526183 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.526165    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.529322 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.529300    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bkg28\""
Jul 28 12:57:07.529438 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.529353    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 12:57:07.530480 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.530462    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 12:57:07.537136 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.537111    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"]
Jul 28 12:57:07.624778 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.624739    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v82p\" (UniqueName: \"kubernetes.io/projected/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-kube-api-access-6v82p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.624991 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.624788    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.624991 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.624846    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.725805 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.725766    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.726023 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.725849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v82p\" (UniqueName: \"kubernetes.io/projected/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-kube-api-access-6v82p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.726023 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.725884    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.726188 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.726166    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.726274 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.726256    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.737006 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.736980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v82p\" (UniqueName: \"kubernetes.io/projected/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-kube-api-access-6v82p\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.835005 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.834884    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:07.964377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:07.964328    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"]
Jul 28 12:57:07.966539 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:57:07.966513    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4383ff7_50aa_4b29_b6fb_2a7cdc96e444.slice/crio-7183edf7d6908c77cce6d3e66ddfc1d9a92d8268f54dc5c840f1c930135557dd WatchSource:0}: Error finding container 7183edf7d6908c77cce6d3e66ddfc1d9a92d8268f54dc5c840f1c930135557dd: Status 404 returned error can't find the container with id 7183edf7d6908c77cce6d3e66ddfc1d9a92d8268f54dc5c840f1c930135557dd
Jul 28 12:57:08.918377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:08.918347    2567 generic.go:356] "Generic (PLEG): container finished" podID="a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" containerID="e48f86a1cf39be6c1724c609d050d045c1cf02654812728635ab305bc6da137e" exitCode=0
Jul 28 12:57:08.918748 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:08.918429    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb" event={"ID":"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444","Type":"ContainerDied","Data":"e48f86a1cf39be6c1724c609d050d045c1cf02654812728635ab305bc6da137e"}
Jul 28 12:57:08.918748 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:08.918476    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb" event={"ID":"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444","Type":"ContainerStarted","Data":"7183edf7d6908c77cce6d3e66ddfc1d9a92d8268f54dc5c840f1c930135557dd"}
Jul 28 12:57:09.924175 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:09.924082    2567 generic.go:356] "Generic (PLEG): container finished" podID="a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" containerID="d585f376b9b882225d2e11b67b51561bf1b702849ff40bacb202339b2e7f75d3" exitCode=0
Jul 28 12:57:09.924537 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:09.924170    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb" event={"ID":"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444","Type":"ContainerDied","Data":"d585f376b9b882225d2e11b67b51561bf1b702849ff40bacb202339b2e7f75d3"}
Jul 28 12:57:10.160147 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:10.160112    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:10.258992 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:10.258882    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:10.929650 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:10.929620    2567 generic.go:356] "Generic (PLEG): container finished" podID="a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" containerID="06d7bcd4edf31c806190a790d5e84f0c2071b3be00385f84e875ee272262555e" exitCode=0
Jul 28 12:57:10.930074 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:10.929706    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb" event={"ID":"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444","Type":"ContainerDied","Data":"06d7bcd4edf31c806190a790d5e84f0c2071b3be00385f84e875ee272262555e"}
Jul 28 12:57:12.055710 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.055680    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:12.158539 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.158504    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-bundle\") pod \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") "
Jul 28 12:57:12.158745 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.158585    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-util\") pod \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") "
Jul 28 12:57:12.158745 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.158611    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v82p\" (UniqueName: \"kubernetes.io/projected/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-kube-api-access-6v82p\") pod \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\" (UID: \"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444\") "
Jul 28 12:57:12.159263 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.159235    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-bundle" (OuterVolumeSpecName: "bundle") pod "a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" (UID: "a4383ff7-50aa-4b29-b6fb-2a7cdc96e444"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:57:12.160706 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.160683    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-kube-api-access-6v82p" (OuterVolumeSpecName: "kube-api-access-6v82p") pod "a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" (UID: "a4383ff7-50aa-4b29-b6fb-2a7cdc96e444"). InnerVolumeSpecName "kube-api-access-6v82p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:57:12.164168 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.164133    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-util" (OuterVolumeSpecName: "util") pod "a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" (UID: "a4383ff7-50aa-4b29-b6fb-2a7cdc96e444"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:57:12.259310 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.259213    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:57:12.259310 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.259245    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-util\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:57:12.259310 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.259260    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v82p\" (UniqueName: \"kubernetes.io/projected/a4383ff7-50aa-4b29-b6fb-2a7cdc96e444-kube-api-access-6v82p\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:57:12.940399 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.940373    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb"
Jul 28 12:57:12.940577 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.940366    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwm6lb" event={"ID":"a4383ff7-50aa-4b29-b6fb-2a7cdc96e444","Type":"ContainerDied","Data":"7183edf7d6908c77cce6d3e66ddfc1d9a92d8268f54dc5c840f1c930135557dd"}
Jul 28 12:57:12.940577 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:12.940491    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7183edf7d6908c77cce6d3e66ddfc1d9a92d8268f54dc5c840f1c930135557dd"
Jul 28 12:57:19.799661 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:19.799616    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:19.906114 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:19.906070    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:20.383575 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.383542    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:20.723415 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.723289    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:20.827191 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.827155    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:20.927910 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.927882    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"]
Jul 28 12:57:20.928163 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.928152    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" containerName="pull"
Jul 28 12:57:20.928206 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.928165    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" containerName="pull"
Jul 28 12:57:20.928206 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.928173    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" containerName="util"
Jul 28 12:57:20.928206 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.928179    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" containerName="util"
Jul 28 12:57:20.928206 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.928185    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" containerName="extract"
Jul 28 12:57:20.928206 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.928191    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" containerName="extract"
Jul 28 12:57:20.928353 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.928237    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4383ff7-50aa-4b29-b6fb-2a7cdc96e444" containerName="extract"
Jul 28 12:57:20.936042 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.936016    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:20.939424 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.939398    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n5pcj\""
Jul 28 12:57:20.939424 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.939400    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 12:57:20.939612 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.939407    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 12:57:20.939612 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.939448    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 12:57:20.939755 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.939740    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 12:57:20.955469 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:20.955439    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"]
Jul 28 12:57:21.023469 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.023435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-tmp\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.023658 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.023484    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.023658 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.023511    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhtvm\" (UniqueName: \"kubernetes.io/projected/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-kube-api-access-xhtvm\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.023658 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.023573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.023658 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.023606    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-manifests\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.114719 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.114684    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:21.124703 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.124670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-tmp\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.124880 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.124711    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.124880 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.124733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhtvm\" (UniqueName: \"kubernetes.io/projected/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-kube-api-access-xhtvm\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.124880 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.124769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.124880 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.124800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-manifests\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.125236 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.125207    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-manifests\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.127169 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.127140    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-tmp\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.127377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.127355    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.127456 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.127440    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.137531 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.137504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhtvm\" (UniqueName: \"kubernetes.io/projected/9c3687a8-4991-4a6c-a90c-c026c4ee93b9-kube-api-access-xhtvm\") pod \"opendatahub-operator-controller-manager-64bb544cf8-qnv86\" (UID: \"9c3687a8-4991-4a6c-a90c-c026c4ee93b9\") " pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.212520 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.212485    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:21.246586 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.246555    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:21.317454 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.317421    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:21.395645 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.395620    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"]
Jul 28 12:57:21.397460 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:57:21.397430    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3687a8_4991_4a6c_a90c_c026c4ee93b9.slice/crio-030495de05abfe283e7ef30c498f8ff842eba368006e25e631ef78a3066f52e8 WatchSource:0}: Error finding container 030495de05abfe283e7ef30c498f8ff842eba368006e25e631ef78a3066f52e8: Status 404 returned error can't find the container with id 030495de05abfe283e7ef30c498f8ff842eba368006e25e631ef78a3066f52e8
Jul 28 12:57:21.421442 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.421414    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:21.536579 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.536545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:21.670460 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.670372    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:21.982124 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:21.982035    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86" event={"ID":"9c3687a8-4991-4a6c-a90c-c026c4ee93b9","Type":"ContainerStarted","Data":"030495de05abfe283e7ef30c498f8ff842eba368006e25e631ef78a3066f52e8"}
Jul 28 12:57:25.000639 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:25.000598    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86" event={"ID":"9c3687a8-4991-4a6c-a90c-c026c4ee93b9","Type":"ContainerStarted","Data":"b2b8912816c017e60d2fa56c2b9670782407a6ab6852bf7afe46f8344d9440b6"}
Jul 28 12:57:26.006199 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:26.006167    2567 generic.go:356] "Generic (PLEG): container finished" podID="9c3687a8-4991-4a6c-a90c-c026c4ee93b9" containerID="b2b8912816c017e60d2fa56c2b9670782407a6ab6852bf7afe46f8344d9440b6" exitCode=0
Jul 28 12:57:26.006567 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:26.006264    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86" event={"ID":"9c3687a8-4991-4a6c-a90c-c026c4ee93b9","Type":"ContainerDied","Data":"b2b8912816c017e60d2fa56c2b9670782407a6ab6852bf7afe46f8344d9440b6"}
Jul 28 12:57:27.011838 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:27.011803    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86" event={"ID":"9c3687a8-4991-4a6c-a90c-c026c4ee93b9","Type":"ContainerStarted","Data":"e7349faac13cd9759c8c5a1cab88ea8c646b55b9403b377617e805e6ad057be8"}
Jul 28 12:57:27.012296 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:27.011943    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:27.064255 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:27.064196    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86" podStartSLOduration=2.818325771 podStartE2EDuration="7.064174058s" totalImagesPullingTime="3.238253604s" totalInitContainerRuntime="1.007594683s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:57:27.062596322 +0000 UTC m=+373.991880242" watchObservedRunningTime="2026-07-28 12:57:27.064174058 +0000 UTC m=+373.993457976"
Jul 28 12:57:33.207489 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:33.207449    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:33.307321 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:33.307289    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:34.917129 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:34.917091    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:34.980601 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:34.980530    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:38.017851 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:38.017819    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64bb544cf8-qnv86"
Jul 28 12:57:41.840770 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:41.840729    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:42.001726 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:42.001689    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:45.180794 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.180752    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:45.227450 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.227410    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"]
Jul 28 12:57:45.231863 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.231841    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:45.234714 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.234690    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 12:57:45.234849 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.234693    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5jrsj\""
Jul 28 12:57:45.235714 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.235696    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 12:57:45.236016 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.235998    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 12:57:45.236356 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.236020    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 12:57:45.240729 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.240704    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"]
Jul 28 12:57:45.321935 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.321890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-tmp\") pod \"kube-auth-proxy-7897958f89-6zbsc\" (UID: \"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5\") " pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:45.322115 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.321966    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-tls-certs\") pod \"kube-auth-proxy-7897958f89-6zbsc\" (UID: \"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5\") " pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:45.322115 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.322023    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp8qb\" (UniqueName: \"kubernetes.io/projected/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-kube-api-access-mp8qb\") pod \"kube-auth-proxy-7897958f89-6zbsc\" (UID: \"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5\") " pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:45.423277 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.423237    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-tmp\") pod \"kube-auth-proxy-7897958f89-6zbsc\" (UID: \"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5\") " pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:45.423277 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.423282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-tls-certs\") pod \"kube-auth-proxy-7897958f89-6zbsc\" (UID: \"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5\") " pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:45.423546 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.423314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp8qb\" (UniqueName: \"kubernetes.io/projected/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-kube-api-access-mp8qb\") pod \"kube-auth-proxy-7897958f89-6zbsc\" (UID: \"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5\") " pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:45.423546 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:57:45.423427    2567 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 28 12:57:45.423546 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:57:45.423526    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-tls-certs podName:d364df40-37fc-4ecb-b7fa-a84fd7d3afa5 nodeName:}" failed. No retries permitted until 2026-07-28 12:57:45.92350535 +0000 UTC m=+392.852789249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-tls-certs") pod "kube-auth-proxy-7897958f89-6zbsc" (UID: "d364df40-37fc-4ecb-b7fa-a84fd7d3afa5") : secret "kube-auth-proxy-tls" not found
Jul 28 12:57:45.425553 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.425532    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-tmp\") pod \"kube-auth-proxy-7897958f89-6zbsc\" (UID: \"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5\") " pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:45.431113 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.431044    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bfrws"]
Jul 28 12:57:45.434604 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.434584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bfrws"
Jul 28 12:57:45.439042 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.439018    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 28 12:57:45.441140 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.441119    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp8qb\" (UniqueName: \"kubernetes.io/projected/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-kube-api-access-mp8qb\") pod \"kube-auth-proxy-7897958f89-6zbsc\" (UID: \"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5\") " pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:45.443517 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.443491    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-x88rl\""
Jul 28 12:57:45.457575 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.457546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bfrws"]
Jul 28 12:57:45.508071 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.508031    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:45.524061 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.524029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/694cbac9-329f-438d-8b6b-37cc0bf513f9-cert\") pod \"odh-model-controller-7998c67dc4-bfrws\" (UID: \"694cbac9-329f-438d-8b6b-37cc0bf513f9\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfrws"
Jul 28 12:57:45.524214 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.524113    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4k6h\" (UniqueName: \"kubernetes.io/projected/694cbac9-329f-438d-8b6b-37cc0bf513f9-kube-api-access-h4k6h\") pod \"odh-model-controller-7998c67dc4-bfrws\" (UID: \"694cbac9-329f-438d-8b6b-37cc0bf513f9\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfrws"
Jul 28 12:57:45.601165 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.601126    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:45.625179 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.625153    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/694cbac9-329f-438d-8b6b-37cc0bf513f9-cert\") pod \"odh-model-controller-7998c67dc4-bfrws\" (UID: \"694cbac9-329f-438d-8b6b-37cc0bf513f9\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfrws"
Jul 28 12:57:45.625358 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.625335    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4k6h\" (UniqueName: \"kubernetes.io/projected/694cbac9-329f-438d-8b6b-37cc0bf513f9-kube-api-access-h4k6h\") pod \"odh-model-controller-7998c67dc4-bfrws\" (UID: \"694cbac9-329f-438d-8b6b-37cc0bf513f9\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfrws"
Jul 28 12:57:45.627629 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.627595    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/694cbac9-329f-438d-8b6b-37cc0bf513f9-cert\") pod \"odh-model-controller-7998c67dc4-bfrws\" (UID: \"694cbac9-329f-438d-8b6b-37cc0bf513f9\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfrws"
Jul 28 12:57:45.640574 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.640536    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4k6h\" (UniqueName: \"kubernetes.io/projected/694cbac9-329f-438d-8b6b-37cc0bf513f9-kube-api-access-h4k6h\") pod \"odh-model-controller-7998c67dc4-bfrws\" (UID: \"694cbac9-329f-438d-8b6b-37cc0bf513f9\") " pod="opendatahub/odh-model-controller-7998c67dc4-bfrws"
Jul 28 12:57:45.695475 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.695385    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:45.753793 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.753756    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bfrws"
Jul 28 12:57:45.895455 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.895434    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bfrws"]
Jul 28 12:57:45.897574 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:57:45.897549    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694cbac9_329f_438d_8b6b_37cc0bf513f9.slice/crio-0fc4a4b804801fbcf61348bc3e40f10df4dc98e2f922af48f0c80300adf3bc9d WatchSource:0}: Error finding container 0fc4a4b804801fbcf61348bc3e40f10df4dc98e2f922af48f0c80300adf3bc9d: Status 404 returned error can't find the container with id 0fc4a4b804801fbcf61348bc3e40f10df4dc98e2f922af48f0c80300adf3bc9d
Jul 28 12:57:45.928444 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.928416    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-tls-certs\") pod \"kube-auth-proxy-7897958f89-6zbsc\" (UID: \"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5\") " pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:45.930931 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:45.930885    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d364df40-37fc-4ecb-b7fa-a84fd7d3afa5-tls-certs\") pod \"kube-auth-proxy-7897958f89-6zbsc\" (UID: \"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5\") " pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:46.089596 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.089561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bfrws" event={"ID":"694cbac9-329f-438d-8b6b-37cc0bf513f9","Type":"ContainerStarted","Data":"0fc4a4b804801fbcf61348bc3e40f10df4dc98e2f922af48f0c80300adf3bc9d"}
Jul 28 12:57:46.142138 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.142098    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"
Jul 28 12:57:46.286088 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.286066    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7897958f89-6zbsc"]
Jul 28 12:57:46.287868 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:57:46.287839    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd364df40_37fc_4ecb_b7fa_a84fd7d3afa5.slice/crio-e40caa6d90de353db2dcd6af01c0a59ddc2e9b749ec22761ea31a646aafddc46 WatchSource:0}: Error finding container e40caa6d90de353db2dcd6af01c0a59ddc2e9b749ec22761ea31a646aafddc46: Status 404 returned error can't find the container with id e40caa6d90de353db2dcd6af01c0a59ddc2e9b749ec22761ea31a646aafddc46
Jul 28 12:57:46.421964 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.421860    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:46.499700 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.499667    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cnl26"]
Jul 28 12:57:46.504165 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.504141    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cnl26"
Jul 28 12:57:46.506803 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.506775    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hjbbc\""
Jul 28 12:57:46.506955 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.506806    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 28 12:57:46.516476 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.516450    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cnl26"]
Jul 28 12:57:46.634183 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.634141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfsr8\" (UniqueName: \"kubernetes.io/projected/b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1-kube-api-access-jfsr8\") pod \"model-serving-api-54d89bd5fc-cnl26\" (UID: \"b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1\") " pod="opendatahub/model-serving-api-54d89bd5fc-cnl26"
Jul 28 12:57:46.634361 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.634198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1-tls-certs\") pod \"model-serving-api-54d89bd5fc-cnl26\" (UID: \"b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1\") " pod="opendatahub/model-serving-api-54d89bd5fc-cnl26"
Jul 28 12:57:46.668689 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.668639    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:46.669112 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.669091    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"]
Jul 28 12:57:46.672622 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.672564    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.675102 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.675078    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 12:57:46.675301 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.675278    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 12:57:46.675409 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.675280    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-42gv6\""
Jul 28 12:57:46.675523 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.675507    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 12:57:46.675571 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.675561    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 12:57:46.684954 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.684905    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"]
Jul 28 12:57:46.734451 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.734416    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:46.734982 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.734957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfsr8\" (UniqueName: \"kubernetes.io/projected/b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1-kube-api-access-jfsr8\") pod \"model-serving-api-54d89bd5fc-cnl26\" (UID: \"b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1\") " pod="opendatahub/model-serving-api-54d89bd5fc-cnl26"
Jul 28 12:57:46.735098 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.735018    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1-tls-certs\") pod \"model-serving-api-54d89bd5fc-cnl26\" (UID: \"b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1\") " pod="opendatahub/model-serving-api-54d89bd5fc-cnl26"
Jul 28 12:57:46.738608 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.738577    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1-tls-certs\") pod \"model-serving-api-54d89bd5fc-cnl26\" (UID: \"b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1\") " pod="opendatahub/model-serving-api-54d89bd5fc-cnl26"
Jul 28 12:57:46.746005 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.745948    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfsr8\" (UniqueName: \"kubernetes.io/projected/b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1-kube-api-access-jfsr8\") pod \"model-serving-api-54d89bd5fc-cnl26\" (UID: \"b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1\") " pod="opendatahub/model-serving-api-54d89bd5fc-cnl26"
Jul 28 12:57:46.814299 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.814254    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cnl26"
Jul 28 12:57:46.836276 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.835883    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.836276 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.835958    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.836276 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.835993    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.836276 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.836035    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.836276 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.836091    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.836276 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.836127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.836276 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.836157    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcpss\" (UniqueName: \"kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-kube-api-access-hcpss\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.937669 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.936955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcpss\" (UniqueName: \"kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-kube-api-access-hcpss\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.937669 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.937032    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.937669 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.937066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.937669 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.937095    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.937669 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.937137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.937669 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.937190    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.937669 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.937223    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.939246 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.939157    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.943021 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.942996    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.943957 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.943601    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.943957 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.943682    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.945906 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.945863    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.946909 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.946887    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcpss\" (UniqueName: \"kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-kube-api-access-hcpss\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.949341 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.949296    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fbvl2\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:46.985949 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:46.985898    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:47.004532 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:47.004501    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cnl26"]
Jul 28 12:57:47.008692 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:57:47.008654    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03c1757_6a1e_4801_a1cb_4c5a0f38ecb1.slice/crio-96bc88c124ab45d4ab9b0bbd66cdaa01fc8b55f7d780a60cd2b8d177d3adc33f WatchSource:0}: Error finding container 96bc88c124ab45d4ab9b0bbd66cdaa01fc8b55f7d780a60cd2b8d177d3adc33f: Status 404 returned error can't find the container with id 96bc88c124ab45d4ab9b0bbd66cdaa01fc8b55f7d780a60cd2b8d177d3adc33f
Jul 28 12:57:47.102504 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:47.102465    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cnl26" event={"ID":"b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1","Type":"ContainerStarted","Data":"96bc88c124ab45d4ab9b0bbd66cdaa01fc8b55f7d780a60cd2b8d177d3adc33f"}
Jul 28 12:57:47.104663 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:47.104631    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc" event={"ID":"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5","Type":"ContainerStarted","Data":"e40caa6d90de353db2dcd6af01c0a59ddc2e9b749ec22761ea31a646aafddc46"}
Jul 28 12:57:47.189496 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:47.189416    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"]
Jul 28 12:57:47.191388 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:57:47.191355    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fb2de8_0926_4b2c_8e37_ad2da6e2a0ed.slice/crio-73926bf4d52b316f27d12f0859beb20f7ece4fbae91f65cfad346e0de77017d8 WatchSource:0}: Error finding container 73926bf4d52b316f27d12f0859beb20f7ece4fbae91f65cfad346e0de77017d8: Status 404 returned error can't find the container with id 73926bf4d52b316f27d12f0859beb20f7ece4fbae91f65cfad346e0de77017d8
Jul 28 12:57:47.818439 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:47.818402    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:48.115352 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:48.115228    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2" event={"ID":"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed","Type":"ContainerStarted","Data":"73926bf4d52b316f27d12f0859beb20f7ece4fbae91f65cfad346e0de77017d8"}
Jul 28 12:57:51.133680 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:51.133574    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bfrws" event={"ID":"694cbac9-329f-438d-8b6b-37cc0bf513f9","Type":"ContainerStarted","Data":"e23a36fb054e4fd0ee44bf3740bf5ba2ee577cd9e871476efda17bf22fc913fb"}
Jul 28 12:57:51.133680 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:51.133649    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bfrws"
Jul 28 12:57:51.135272 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:51.135243    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cnl26" event={"ID":"b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1","Type":"ContainerStarted","Data":"aa2742cd3f1c34a2f1fe43c4c1de486afa4ceffe0c2a7d7f12c72e53fea3cae5"}
Jul 28 12:57:51.135426 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:51.135334    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cnl26"
Jul 28 12:57:51.136734 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:51.136699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc" event={"ID":"d364df40-37fc-4ecb-b7fa-a84fd7d3afa5","Type":"ContainerStarted","Data":"9a368e7d994fce25563b22a2d85f28e9ced2f4b1e737db0aeebf0855cdb6f5a2"}
Jul 28 12:57:51.151492 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:51.151432    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bfrws" podStartSLOduration=1.767800415 podStartE2EDuration="6.151408917s" totalImagesPullingTime="4.383608502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:57:51.150310589 +0000 UTC m=+398.079594505" watchObservedRunningTime="2026-07-28 12:57:51.151408917 +0000 UTC m=+398.080692836"
Jul 28 12:57:51.167594 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:51.167528    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7897958f89-6zbsc" podStartSLOduration=2.167578767 podStartE2EDuration="6.167507867s" totalImagesPullingTime="3.9999291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:57:51.166035048 +0000 UTC m=+398.095318966" watchObservedRunningTime="2026-07-28 12:57:51.167507867 +0000 UTC m=+398.096791786"
Jul 28 12:57:51.186200 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:51.186139    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cnl26" podStartSLOduration=1.915097923 podStartE2EDuration="5.186121579s" totalImagesPullingTime="3.271023656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:57:51.184756036 +0000 UTC m=+398.114039954" watchObservedRunningTime="2026-07-28 12:57:51.186121579 +0000 UTC m=+398.115405496"
Jul 28 12:57:56.802875 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.802828    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:56.897165 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.897072    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"]
Jul 28 12:57:56.941883 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.941587    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"]
Jul 28 12:57:56.941883 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.941635    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"]
Jul 28 12:57:56.942832 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.942259    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"
Jul 28 12:57:56.947419 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.946527    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 28 12:57:56.947419 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.946819    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qg64x\""
Jul 28 12:57:56.948737 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.948656    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:56.972178 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.972135    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"]
Jul 28 12:57:56.972327 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.972280    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:57:56.976603 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.976577    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 28 12:57:56.976913 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:56.976895    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xw7hd\""
Jul 28 12:57:57.102887 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.102770    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:57.128847 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.128813    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80b60f4e-b14d-4c03-a656-ba6a548e9242-cert\") pod \"kserve-controller-manager-d6f4b65b8-9zqxq\" (UID: \"80b60f4e-b14d-4c03-a656-ba6a548e9242\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"
Jul 28 12:57:57.129049 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.128861    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b964906-db9c-46da-96c8-e0270325bbfa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kjhqq\" (UID: \"0b964906-db9c-46da-96c8-e0270325bbfa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:57:57.129049 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.128983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxs24\" (UniqueName: \"kubernetes.io/projected/0b964906-db9c-46da-96c8-e0270325bbfa-kube-api-access-nxs24\") pod \"llmisvc-controller-manager-777c6bd7d5-kjhqq\" (UID: \"0b964906-db9c-46da-96c8-e0270325bbfa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:57:57.129049 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.129041    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t8vz\" (UniqueName: \"kubernetes.io/projected/80b60f4e-b14d-4c03-a656-ba6a548e9242-kube-api-access-6t8vz\") pod \"kserve-controller-manager-d6f4b65b8-9zqxq\" (UID: \"80b60f4e-b14d-4c03-a656-ba6a548e9242\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"
Jul 28 12:57:57.230571 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.229988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80b60f4e-b14d-4c03-a656-ba6a548e9242-cert\") pod \"kserve-controller-manager-d6f4b65b8-9zqxq\" (UID: \"80b60f4e-b14d-4c03-a656-ba6a548e9242\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"
Jul 28 12:57:57.230571 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.230049    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b964906-db9c-46da-96c8-e0270325bbfa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kjhqq\" (UID: \"0b964906-db9c-46da-96c8-e0270325bbfa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:57:57.230571 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.230113    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxs24\" (UniqueName: \"kubernetes.io/projected/0b964906-db9c-46da-96c8-e0270325bbfa-kube-api-access-nxs24\") pod \"llmisvc-controller-manager-777c6bd7d5-kjhqq\" (UID: \"0b964906-db9c-46da-96c8-e0270325bbfa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:57:57.230571 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.230171    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t8vz\" (UniqueName: \"kubernetes.io/projected/80b60f4e-b14d-4c03-a656-ba6a548e9242-kube-api-access-6t8vz\") pod \"kserve-controller-manager-d6f4b65b8-9zqxq\" (UID: \"80b60f4e-b14d-4c03-a656-ba6a548e9242\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"
Jul 28 12:57:57.230571 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:57:57.230364    2567 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 28 12:57:57.230991 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:57:57.230604    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b964906-db9c-46da-96c8-e0270325bbfa-cert podName:0b964906-db9c-46da-96c8-e0270325bbfa nodeName:}" failed. No retries permitted until 2026-07-28 12:57:57.730560805 +0000 UTC m=+404.659844714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0b964906-db9c-46da-96c8-e0270325bbfa-cert") pod "llmisvc-controller-manager-777c6bd7d5-kjhqq" (UID: "0b964906-db9c-46da-96c8-e0270325bbfa") : secret "llmisvc-webhook-server-cert" not found
Jul 28 12:57:57.233138 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.233116    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/80b60f4e-b14d-4c03-a656-ba6a548e9242-cert\") pod \"kserve-controller-manager-d6f4b65b8-9zqxq\" (UID: \"80b60f4e-b14d-4c03-a656-ba6a548e9242\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"
Jul 28 12:57:57.245485 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.245453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxs24\" (UniqueName: \"kubernetes.io/projected/0b964906-db9c-46da-96c8-e0270325bbfa-kube-api-access-nxs24\") pod \"llmisvc-controller-manager-777c6bd7d5-kjhqq\" (UID: \"0b964906-db9c-46da-96c8-e0270325bbfa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:57:57.248757 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.248726    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t8vz\" (UniqueName: \"kubernetes.io/projected/80b60f4e-b14d-4c03-a656-ba6a548e9242-kube-api-access-6t8vz\") pod \"kserve-controller-manager-d6f4b65b8-9zqxq\" (UID: \"80b60f4e-b14d-4c03-a656-ba6a548e9242\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"
Jul 28 12:57:57.259605 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.259575    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"
Jul 28 12:57:57.436605 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.436572    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"]
Jul 28 12:57:57.463173 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.463141    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:57.734320 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.734217    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b964906-db9c-46da-96c8-e0270325bbfa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kjhqq\" (UID: \"0b964906-db9c-46da-96c8-e0270325bbfa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:57:57.737027 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.737000    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b964906-db9c-46da-96c8-e0270325bbfa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kjhqq\" (UID: \"0b964906-db9c-46da-96c8-e0270325bbfa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:57:57.885782 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.885744    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:57:57.902030 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:57.901990    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:58.061755 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.061718    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:58.163020 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.162951    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:58.247689 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:57:58.247653    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80b60f4e_b14d_4c03_a656_ba6a548e9242.slice/crio-0e0fc5c7485f9f38d2419adfc96c0352c4f2a907d09733074610ff26ce768587 WatchSource:0}: Error finding container 0e0fc5c7485f9f38d2419adfc96c0352c4f2a907d09733074610ff26ce768587: Status 404 returned error can't find the container with id 0e0fc5c7485f9f38d2419adfc96c0352c4f2a907d09733074610ff26ce768587
Jul 28 12:57:58.277283 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.277230    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:58.310633 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.310588    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 12:57:58.310743 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.310689    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 12:57:58.402357 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.402332    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"]
Jul 28 12:57:58.402562 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:57:58.402541    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0b964906_db9c_46da_96c8_e0270325bbfa.slice/crio-72a9839f256e49ff1baec4bb205fbae22d1e1a8f64e593a895f7d8e8fcb809ef WatchSource:0}: Error finding container 72a9839f256e49ff1baec4bb205fbae22d1e1a8f64e593a895f7d8e8fcb809ef: Status 404 returned error can't find the container with id 72a9839f256e49ff1baec4bb205fbae22d1e1a8f64e593a895f7d8e8fcb809ef
Jul 28 12:57:58.941749 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.941715    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"]
Jul 28 12:57:58.945238 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.945194    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:58.949042 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.948998    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bbqq8\""
Jul 28 12:57:58.960799 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.960771    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"]
Jul 28 12:57:58.980170 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:58.980107    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:59.046045 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.046011    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.046045 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.046052    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.046267 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.046071    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.046267 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.046088    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.046267 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.046162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/338c18b9-7653-48cf-8e72-001f509376cf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.046267 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.046237    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/338c18b9-7653-48cf-8e72-001f509376cf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.046267 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.046269    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdvsc\" (UniqueName: \"kubernetes.io/projected/338c18b9-7653-48cf-8e72-001f509376cf-kube-api-access-pdvsc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.046451 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.046299    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/338c18b9-7653-48cf-8e72-001f509376cf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.046451 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.046341    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.094034 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.093953    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:59.146983 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.146943    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.147161 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147024    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.147161 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147062    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.147161 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147082    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.147161 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147107    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.147161 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147129    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/338c18b9-7653-48cf-8e72-001f509376cf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.147438 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147204    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/338c18b9-7653-48cf-8e72-001f509376cf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.147438 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147235    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdvsc\" (UniqueName: \"kubernetes.io/projected/338c18b9-7653-48cf-8e72-001f509376cf-kube-api-access-pdvsc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.147438 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147278    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/338c18b9-7653-48cf-8e72-001f509376cf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.147603 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147433    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.148146 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.148146 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.147947    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/338c18b9-7653-48cf-8e72-001f509376cf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.148146 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.148072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.148146 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.148124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.150076 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.150048    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/338c18b9-7653-48cf-8e72-001f509376cf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.150354 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.150335    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/338c18b9-7653-48cf-8e72-001f509376cf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.171835 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.171797    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdvsc\" (UniqueName: \"kubernetes.io/projected/338c18b9-7653-48cf-8e72-001f509376cf-kube-api-access-pdvsc\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.180056 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.180016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2" event={"ID":"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed","Type":"ContainerStarted","Data":"c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb"}
Jul 28 12:57:59.181029 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.180395    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:57:59.182298 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.182238    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-fbvl2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 12:57:59.182416 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.182331    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2" podUID="36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 12:57:59.182630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.182608    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/338c18b9-7653-48cf-8e72-001f509376cf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p\" (UID: \"338c18b9-7653-48cf-8e72-001f509376cf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.183293 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.183228    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq" event={"ID":"80b60f4e-b14d-4c03-a656-ba6a548e9242","Type":"ContainerStarted","Data":"0e0fc5c7485f9f38d2419adfc96c0352c4f2a907d09733074610ff26ce768587"}
Jul 28 12:57:59.184885 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.184858    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq" event={"ID":"0b964906-db9c-46da-96c8-e0270325bbfa","Type":"ContainerStarted","Data":"72a9839f256e49ff1baec4bb205fbae22d1e1a8f64e593a895f7d8e8fcb809ef"}
Jul 28 12:57:59.216858 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.216752    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2" podStartSLOduration=2.101782511 podStartE2EDuration="13.21672806s" totalImagesPullingTime="11.114945549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:57:59.214876392 +0000 UTC m=+406.144160310" watchObservedRunningTime="2026-07-28 12:57:59.21672806 +0000 UTC m=+406.146011980"
Jul 28 12:57:59.233902 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.233868    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:57:59.257848 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.257814    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:57:59.448701 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.448655    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"]
Jul 28 12:57:59.803533 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:57:59.803491    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"]
Jul 28 12:57:59.871857 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:57:59.871816    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338c18b9_7653_48cf_8e72_001f509376cf.slice/crio-5b0ae718ecc71b61d11a429caf9ba340af2b26ceaf5a588bcd88da1194ad1721 WatchSource:0}: Error finding container 5b0ae718ecc71b61d11a429caf9ba340af2b26ceaf5a588bcd88da1194ad1721: Status 404 returned error can't find the container with id 5b0ae718ecc71b61d11a429caf9ba340af2b26ceaf5a588bcd88da1194ad1721
Jul 28 12:58:00.191126 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:00.191094    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p" event={"ID":"338c18b9-7653-48cf-8e72-001f509376cf","Type":"ContainerStarted","Data":"5b0ae718ecc71b61d11a429caf9ba340af2b26ceaf5a588bcd88da1194ad1721"}
Jul 28 12:58:00.192183 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:00.192162    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:58:01.200444 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.200395    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2" podUID="36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" containerName="discovery" containerID="cri-o://c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb" gracePeriod=30
Jul 28 12:58:01.201010 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.200501    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq" event={"ID":"80b60f4e-b14d-4c03-a656-ba6a548e9242","Type":"ContainerStarted","Data":"6277f311ba66c806f2773888cef9eb29b7d8d6d8745ff5931357b6b7653c94ce"}
Jul 28 12:58:01.201010 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.200778    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"
Jul 28 12:58:01.268234 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.268172    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq" podStartSLOduration=2.917582177 podStartE2EDuration="5.268153314s" totalImagesPullingTime="2.350571137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:58:01.267170867 +0000 UTC m=+408.196454804" watchObservedRunningTime="2026-07-28 12:58:01.268153314 +0000 UTC m=+408.197437230"
Jul 28 12:58:01.595561 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.595529    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:58:01.684836 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.684802    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-dns-cert\") pod \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") "
Jul 28 12:58:01.684836 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.684844    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-token\") pod \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") "
Jul 28 12:58:01.685107 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.684865    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-kubeconfig\") pod \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") "
Jul 28 12:58:01.685107 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.684890    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-cacerts\") pod \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") "
Jul 28 12:58:01.685107 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.684934    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-ca-configmap\") pod \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") "
Jul 28 12:58:01.685107 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.684983    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcpss\" (UniqueName: \"kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-kube-api-access-hcpss\") pod \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") "
Jul 28 12:58:01.685107 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.685006    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-local-certs\") pod \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\" (UID: \"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed\") "
Jul 28 12:58:01.685905 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.685856    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" (UID: "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 12:58:01.688201 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.688159    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" (UID: "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:58:01.688201 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.688164    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" (UID: "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:58:01.688376 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.688238    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" (UID: "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:58:01.688585 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.688561    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-cacerts" (OuterVolumeSpecName: "cacerts") pod "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" (UID: "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 12:58:01.688895 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.688869    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-kube-api-access-hcpss" (OuterVolumeSpecName: "kube-api-access-hcpss") pod "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" (UID: "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed"). InnerVolumeSpecName "kube-api-access-hcpss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:58:01.688963 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.688875    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-local-certs" (OuterVolumeSpecName: "local-certs") pod "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" (UID: "36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:58:01.786041 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.786007    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcpss\" (UniqueName: \"kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-kube-api-access-hcpss\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:58:01.786041 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.786038    2567 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-local-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:58:01.786041 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.786049    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-dns-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:58:01.786375 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.786057    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:58:01.786375 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.786066    2567 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-kubeconfig\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:58:01.786375 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.786074    2567 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-cacerts\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:58:01.786375 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:01.786084    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed-istio-csr-ca-configmap\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:58:02.144481 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.144378    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bfrws"
Jul 28 12:58:02.147199 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.147173    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cnl26"
Jul 28 12:58:02.221042 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.220967    2567 generic.go:356] "Generic (PLEG): container finished" podID="36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" containerID="c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb" exitCode=0
Jul 28 12:58:02.221513 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.221116    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2" event={"ID":"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed","Type":"ContainerDied","Data":"c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb"}
Jul 28 12:58:02.221513 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.221193    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"
Jul 28 12:58:02.221513 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.221207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2" event={"ID":"36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed","Type":"ContainerDied","Data":"73926bf4d52b316f27d12f0859beb20f7ece4fbae91f65cfad346e0de77017d8"}
Jul 28 12:58:02.221513 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.221239    2567 scope.go:117] "RemoveContainer" containerID="c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb"
Jul 28 12:58:02.224232 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.223955    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq" event={"ID":"0b964906-db9c-46da-96c8-e0270325bbfa","Type":"ContainerStarted","Data":"6a7a087850a7f310a8f1e6faa54303fb9b3bab40e2429fca394be9734f9079fe"}
Jul 28 12:58:02.247135 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.247082    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq" podStartSLOduration=3.179386127 podStartE2EDuration="6.247064257s" totalImagesPullingTime="3.06767813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:58:02.246547471 +0000 UTC m=+409.175831401" watchObservedRunningTime="2026-07-28 12:58:02.247064257 +0000 UTC m=+409.176348174"
Jul 28 12:58:02.261886 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.261835    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"]
Jul 28 12:58:02.266453 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.266416    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fbvl2"]
Jul 28 12:58:02.701711 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.701684    2567 scope.go:117] "RemoveContainer" containerID="c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb"
Jul 28 12:58:02.702140 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:58:02.702103    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb\": container with ID starting with c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb not found: ID does not exist" containerID="c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb"
Jul 28 12:58:02.702269 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.702159    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb"} err="failed to get container status \"c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb\": rpc error: code = NotFound desc = could not find container \"c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb\": container with ID starting with c05ef4914fa6927cd4ea5a08077140b25fdf03de8f0722c2b170bde671c39ddb not found: ID does not exist"
Jul 28 12:58:02.765928 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.765875    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 12:58:02.766029 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.766002    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 12:58:02.766065 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:02.766034    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 12:58:03.232584 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:03.232544    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p" event={"ID":"338c18b9-7653-48cf-8e72-001f509376cf","Type":"ContainerStarted","Data":"d7aae4572af7f2ba6dc096eb646e231a92a21a0e9df3bb9c5e13b1f495258e35"}
Jul 28 12:58:03.233062 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:03.232722    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:58:03.258734 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:03.258699    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:58:03.263848 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:03.263820    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:58:03.264770 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:03.264724    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p" podStartSLOduration=2.373343842 podStartE2EDuration="5.264708549s" totalImagesPullingTime="2.891364707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:57:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:58:03.262032366 +0000 UTC m=+410.191316285" watchObservedRunningTime="2026-07-28 12:58:03.264708549 +0000 UTC m=+410.193992466"
Jul 28 12:58:03.502943 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:03.502841    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" path="/var/lib/kubelet/pods/36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed/volumes"
Jul 28 12:58:04.237627 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:04.237596    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:58:04.238652 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:04.238635    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p"
Jul 28 12:58:32.230067 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:32.230036    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9zqxq"
Jul 28 12:58:34.239979 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:34.239948    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kjhqq"
Jul 28 12:58:43.328688 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.328602    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:58:43.430932 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.430894    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:58:43.482955 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.482905    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4zfs"]
Jul 28 12:58:43.483282 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.483265    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" containerName="discovery"
Jul 28 12:58:43.483364 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.483285    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" containerName="discovery"
Jul 28 12:58:43.483416 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.483383    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="36fb2de8-0926-4b2c-8e37-ad2da6e2a0ed" containerName="discovery"
Jul 28 12:58:43.486212 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.486190    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z4zfs"
Jul 28 12:58:43.488698 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.488679    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 12:58:43.488698 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.488688    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 12:58:43.489377 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.489157    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6p5xr\""
Jul 28 12:58:43.501722 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.501697    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4zfs"]
Jul 28 12:58:43.542091 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.542056    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:58:43.621055 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.620967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd6nd\" (UniqueName: \"kubernetes.io/projected/44b01531-1300-4ac6-8487-92710b38ebf9-kube-api-access-rd6nd\") pod \"kuadrant-operator-catalog-z4zfs\" (UID: \"44b01531-1300-4ac6-8487-92710b38ebf9\") " pod="kuadrant-system/kuadrant-operator-catalog-z4zfs"
Jul 28 12:58:43.722192 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.722156    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd6nd\" (UniqueName: \"kubernetes.io/projected/44b01531-1300-4ac6-8487-92710b38ebf9-kube-api-access-rd6nd\") pod \"kuadrant-operator-catalog-z4zfs\" (UID: \"44b01531-1300-4ac6-8487-92710b38ebf9\") " pod="kuadrant-system/kuadrant-operator-catalog-z4zfs"
Jul 28 12:58:43.731231 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.731206    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd6nd\" (UniqueName: \"kubernetes.io/projected/44b01531-1300-4ac6-8487-92710b38ebf9-kube-api-access-rd6nd\") pod \"kuadrant-operator-catalog-z4zfs\" (UID: \"44b01531-1300-4ac6-8487-92710b38ebf9\") " pod="kuadrant-system/kuadrant-operator-catalog-z4zfs"
Jul 28 12:58:43.796429 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.796390    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z4zfs"
Jul 28 12:58:43.839040 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.839010    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4zfs"]
Jul 28 12:58:43.942988 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:43.942963    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4zfs"]
Jul 28 12:58:43.944901 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:58:43.944876    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b01531_1300_4ac6_8487_92710b38ebf9.slice/crio-e74c67bf4774e82b5b2bd950473c22193f4f2be0a6e37fda20ed53840eda7174 WatchSource:0}: Error finding container e74c67bf4774e82b5b2bd950473c22193f4f2be0a6e37fda20ed53840eda7174: Status 404 returned error can't find the container with id e74c67bf4774e82b5b2bd950473c22193f4f2be0a6e37fda20ed53840eda7174
Jul 28 12:58:44.050392 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:44.050355    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k8dq6"]
Jul 28 12:58:44.054601 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:44.054584    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k8dq6"
Jul 28 12:58:44.062966 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:44.062942    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k8dq6"]
Jul 28 12:58:44.124645 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:44.124593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzgg7\" (UniqueName: \"kubernetes.io/projected/fde928d7-a768-4992-a103-805c3fd5a836-kube-api-access-fzgg7\") pod \"kuadrant-operator-catalog-k8dq6\" (UID: \"fde928d7-a768-4992-a103-805c3fd5a836\") " pod="kuadrant-system/kuadrant-operator-catalog-k8dq6"
Jul 28 12:58:44.226013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:44.225910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzgg7\" (UniqueName: \"kubernetes.io/projected/fde928d7-a768-4992-a103-805c3fd5a836-kube-api-access-fzgg7\") pod \"kuadrant-operator-catalog-k8dq6\" (UID: \"fde928d7-a768-4992-a103-805c3fd5a836\") " pod="kuadrant-system/kuadrant-operator-catalog-k8dq6"
Jul 28 12:58:44.235936 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:44.235810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzgg7\" (UniqueName: \"kubernetes.io/projected/fde928d7-a768-4992-a103-805c3fd5a836-kube-api-access-fzgg7\") pod \"kuadrant-operator-catalog-k8dq6\" (UID: \"fde928d7-a768-4992-a103-805c3fd5a836\") " pod="kuadrant-system/kuadrant-operator-catalog-k8dq6"
Jul 28 12:58:44.364647 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:44.364604    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k8dq6"
Jul 28 12:58:44.427648 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:44.427614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z4zfs" event={"ID":"44b01531-1300-4ac6-8487-92710b38ebf9","Type":"ContainerStarted","Data":"e74c67bf4774e82b5b2bd950473c22193f4f2be0a6e37fda20ed53840eda7174"}
Jul 28 12:58:44.505536 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:44.505314    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k8dq6"]
Jul 28 12:58:44.549820 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:58:44.549789    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde928d7_a768_4992_a103_805c3fd5a836.slice/crio-5317d0e9610e77848c1b2273ea3dec5eafa8a962e6541b9894fb25c63fb580c2 WatchSource:0}: Error finding container 5317d0e9610e77848c1b2273ea3dec5eafa8a962e6541b9894fb25c63fb580c2: Status 404 returned error can't find the container with id 5317d0e9610e77848c1b2273ea3dec5eafa8a962e6541b9894fb25c63fb580c2
Jul 28 12:58:45.434997 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:45.434957    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k8dq6" event={"ID":"fde928d7-a768-4992-a103-805c3fd5a836","Type":"ContainerStarted","Data":"5317d0e9610e77848c1b2273ea3dec5eafa8a962e6541b9894fb25c63fb580c2"}
Jul 28 12:58:46.441327 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:46.441234    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k8dq6" event={"ID":"fde928d7-a768-4992-a103-805c3fd5a836","Type":"ContainerStarted","Data":"7d7cb0c2adc50f692857180cc0190546a0aaf51c257baf76cffed4bc981a1336"}
Jul 28 12:58:46.442778 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:46.442758    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z4zfs" event={"ID":"44b01531-1300-4ac6-8487-92710b38ebf9","Type":"ContainerStarted","Data":"82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879"}
Jul 28 12:58:46.442883 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:46.442853    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-z4zfs" podUID="44b01531-1300-4ac6-8487-92710b38ebf9" containerName="registry-server" containerID="cri-o://82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879" gracePeriod=2
Jul 28 12:58:46.460509 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:46.460458    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-k8dq6" podStartSLOduration=0.977431969 podStartE2EDuration="2.460441535s" totalImagesPullingTime="1.483009566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:58:46.45914739 +0000 UTC m=+453.388431319" watchObservedRunningTime="2026-07-28 12:58:46.460441535 +0000 UTC m=+453.389725451"
Jul 28 12:58:46.476141 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:46.476095    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-z4zfs" podStartSLOduration=1.3910571680000001 podStartE2EDuration="3.476077279s" totalImagesPullingTime="2.085020111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:58:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:58:46.476036295 +0000 UTC m=+453.405320212" watchObservedRunningTime="2026-07-28 12:58:46.476077279 +0000 UTC m=+453.405361196"
Jul 28 12:58:46.692045 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:46.691986    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z4zfs"
Jul 28 12:58:46.850555 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:46.850514    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rd6nd\" (UniqueName: \"kubernetes.io/projected/44b01531-1300-4ac6-8487-92710b38ebf9-kube-api-access-rd6nd\") pod \"44b01531-1300-4ac6-8487-92710b38ebf9\" (UID: \"44b01531-1300-4ac6-8487-92710b38ebf9\") "
Jul 28 12:58:46.852719 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:46.852676    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b01531-1300-4ac6-8487-92710b38ebf9-kube-api-access-rd6nd" (OuterVolumeSpecName: "kube-api-access-rd6nd") pod "44b01531-1300-4ac6-8487-92710b38ebf9" (UID: "44b01531-1300-4ac6-8487-92710b38ebf9"). InnerVolumeSpecName "kube-api-access-rd6nd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:58:46.952099 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:46.952009    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd6nd\" (UniqueName: \"kubernetes.io/projected/44b01531-1300-4ac6-8487-92710b38ebf9-kube-api-access-rd6nd\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:58:47.448616 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:47.448580    2567 generic.go:356] "Generic (PLEG): container finished" podID="44b01531-1300-4ac6-8487-92710b38ebf9" containerID="82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879" exitCode=0
Jul 28 12:58:47.449114 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:47.448628    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z4zfs"
Jul 28 12:58:47.449114 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:47.448663    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z4zfs" event={"ID":"44b01531-1300-4ac6-8487-92710b38ebf9","Type":"ContainerDied","Data":"82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879"}
Jul 28 12:58:47.449114 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:47.448715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z4zfs" event={"ID":"44b01531-1300-4ac6-8487-92710b38ebf9","Type":"ContainerDied","Data":"e74c67bf4774e82b5b2bd950473c22193f4f2be0a6e37fda20ed53840eda7174"}
Jul 28 12:58:47.449114 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:47.448736    2567 scope.go:117] "RemoveContainer" containerID="82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879"
Jul 28 12:58:47.457334 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:47.457309    2567 scope.go:117] "RemoveContainer" containerID="82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879"
Jul 28 12:58:47.457639 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:58:47.457617    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879\": container with ID starting with 82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879 not found: ID does not exist" containerID="82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879"
Jul 28 12:58:47.457709 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:47.457648    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879"} err="failed to get container status \"82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879\": rpc error: code = NotFound desc = could not find container \"82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879\": container with ID starting with 82533a6845291dc4a7cfe294caddc52a664c98436402c46e112f6e763f968879 not found: ID does not exist"
Jul 28 12:58:47.468575 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:47.468546    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4zfs"]
Jul 28 12:58:47.472309 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:47.472288    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z4zfs"]
Jul 28 12:58:47.500288 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:47.500259    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b01531-1300-4ac6-8487-92710b38ebf9" path="/var/lib/kubelet/pods/44b01531-1300-4ac6-8487-92710b38ebf9/volumes"
Jul 28 12:58:54.365107 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:54.365062    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-k8dq6"
Jul 28 12:58:54.365531 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:54.365144    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-k8dq6"
Jul 28 12:58:54.386573 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:54.386539    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-k8dq6"
Jul 28 12:58:54.501018 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:54.500990    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-k8dq6"
Jul 28 12:58:58.876513 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:58.876476    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"]
Jul 28 12:58:58.876952 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:58.876802    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b01531-1300-4ac6-8487-92710b38ebf9" containerName="registry-server"
Jul 28 12:58:58.876952 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:58.876813    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b01531-1300-4ac6-8487-92710b38ebf9" containerName="registry-server"
Jul 28 12:58:58.876952 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:58.876872    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b01531-1300-4ac6-8487-92710b38ebf9" containerName="registry-server"
Jul 28 12:58:58.882398 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:58.882367    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:58.885447 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:58.885411    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kwnnr\""
Jul 28 12:58:58.890616 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:58.890589    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"]
Jul 28 12:58:58.957256 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:58.957212    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:58.957256 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:58.957252    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:58.957482 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:58.957273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6thv\" (UniqueName: \"kubernetes.io/projected/57d0f186-5a36-4b9d-b0ff-621ba3080078-kube-api-access-d6thv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:59.057630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.057591    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:59.057630 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.057629    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:59.057850 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.057666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6thv\" (UniqueName: \"kubernetes.io/projected/57d0f186-5a36-4b9d-b0ff-621ba3080078-kube-api-access-d6thv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:59.058120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.058084    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:59.058177 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.058093    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:59.066910 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.066884    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6thv\" (UniqueName: \"kubernetes.io/projected/57d0f186-5a36-4b9d-b0ff-621ba3080078-kube-api-access-d6thv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:59.193147 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.193036    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:58:59.286592 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.286558    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"]
Jul 28 12:58:59.295886 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.295860    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.304714 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.304412    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"]
Jul 28 12:58:59.342017 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.341992    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"]
Jul 28 12:58:59.344557 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:58:59.344526    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d0f186_5a36_4b9d_b0ff_621ba3080078.slice/crio-79115e786195f838923aeecb323ba6cdb1fdcb048cb2646d53526e6f4ac71352 WatchSource:0}: Error finding container 79115e786195f838923aeecb323ba6cdb1fdcb048cb2646d53526e6f4ac71352: Status 404 returned error can't find the container with id 79115e786195f838923aeecb323ba6cdb1fdcb048cb2646d53526e6f4ac71352
Jul 28 12:58:59.359026 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.358983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.359146 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.359044    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfwzn\" (UniqueName: \"kubernetes.io/projected/a6870421-30a2-4834-acd1-df2c2c434dfa-kube-api-access-xfwzn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.359146 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.359100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.459875 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.459848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfwzn\" (UniqueName: \"kubernetes.io/projected/a6870421-30a2-4834-acd1-df2c2c434dfa-kube-api-access-xfwzn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.460023 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.459896    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.460023 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.459965    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.460359 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.460338    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.460397 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.460345    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.469569 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.469542    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfwzn\" (UniqueName: \"kubernetes.io/projected/a6870421-30a2-4834-acd1-df2c2c434dfa-kube-api-access-xfwzn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.502174 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.502133    2567 generic.go:356] "Generic (PLEG): container finished" podID="57d0f186-5a36-4b9d-b0ff-621ba3080078" containerID="3c03a46701b2a97b2084c195c075575d6767f59b59029c2435e7bdbd9f623a98" exitCode=0
Jul 28 12:58:59.502333 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.502221    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89" event={"ID":"57d0f186-5a36-4b9d-b0ff-621ba3080078","Type":"ContainerDied","Data":"3c03a46701b2a97b2084c195c075575d6767f59b59029c2435e7bdbd9f623a98"}
Jul 28 12:58:59.502333 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.502276    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89" event={"ID":"57d0f186-5a36-4b9d-b0ff-621ba3080078","Type":"ContainerStarted","Data":"79115e786195f838923aeecb323ba6cdb1fdcb048cb2646d53526e6f4ac71352"}
Jul 28 12:58:59.608012 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.607979    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:58:59.705214 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.705134    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"]
Jul 28 12:58:59.714703 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.714677    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:58:59.722033 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.722008    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"]
Jul 28 12:58:59.754523 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.754498    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"]
Jul 28 12:58:59.756129 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:58:59.756102    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6870421_30a2_4834_acd1_df2c2c434dfa.slice/crio-f8fba958e68b0cdf7afe0c079084d0addb601749b826f510843ec8f7cd3a20ec WatchSource:0}: Error finding container f8fba958e68b0cdf7afe0c079084d0addb601749b826f510843ec8f7cd3a20ec: Status 404 returned error can't find the container with id f8fba958e68b0cdf7afe0c079084d0addb601749b826f510843ec8f7cd3a20ec
Jul 28 12:58:59.762078 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.762051    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:58:59.762137 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.762110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:58:59.762191 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.762160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj8hs\" (UniqueName: \"kubernetes.io/projected/7387b635-9d62-43eb-91c6-26a2ccce613c-kube-api-access-gj8hs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:58:59.862856 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.862825    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:58:59.863008 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.862867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:58:59.863008 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.862908    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj8hs\" (UniqueName: \"kubernetes.io/projected/7387b635-9d62-43eb-91c6-26a2ccce613c-kube-api-access-gj8hs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:58:59.863176 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.863159    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:58:59.863209 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.863183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:58:59.871820 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:58:59.871789    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj8hs\" (UniqueName: \"kubernetes.io/projected/7387b635-9d62-43eb-91c6-26a2ccce613c-kube-api-access-gj8hs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:59:00.025832 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.025783    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:59:00.082197 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.082099    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"]
Jul 28 12:59:00.086702 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.086530    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.099324 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.099271    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"]
Jul 28 12:59:00.165541 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.165512    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.165704 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.165612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qszqc\" (UniqueName: \"kubernetes.io/projected/b582cfbb-baee-4a62-b902-0bf98c8e462d-kube-api-access-qszqc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.165704 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.165656    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.174104 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.174081    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"]
Jul 28 12:59:00.218274 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:59:00.218241    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7387b635_9d62_43eb_91c6_26a2ccce613c.slice/crio-e5df6088601857670f015629f6bd2378739565dd54ddeb0e95630d04fe8fdea4 WatchSource:0}: Error finding container e5df6088601857670f015629f6bd2378739565dd54ddeb0e95630d04fe8fdea4: Status 404 returned error can't find the container with id e5df6088601857670f015629f6bd2378739565dd54ddeb0e95630d04fe8fdea4
Jul 28 12:59:00.266603 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.266571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qszqc\" (UniqueName: \"kubernetes.io/projected/b582cfbb-baee-4a62-b902-0bf98c8e462d-kube-api-access-qszqc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.266741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.266640    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.266741 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.266689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.267132 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.267110    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.267209 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.267147    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.276690 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.276629    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qszqc\" (UniqueName: \"kubernetes.io/projected/b582cfbb-baee-4a62-b902-0bf98c8e462d-kube-api-access-qszqc\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.400541 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.400500    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:00.508775 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.508735    2567 generic.go:356] "Generic (PLEG): container finished" podID="a6870421-30a2-4834-acd1-df2c2c434dfa" containerID="5a650078afca9fe30dc64944274a976c8f7bbdd5d2d070d4a0a44009941d32a0" exitCode=0
Jul 28 12:59:00.508959 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.508820    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v" event={"ID":"a6870421-30a2-4834-acd1-df2c2c434dfa","Type":"ContainerDied","Data":"5a650078afca9fe30dc64944274a976c8f7bbdd5d2d070d4a0a44009941d32a0"}
Jul 28 12:59:00.508959 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.508877    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v" event={"ID":"a6870421-30a2-4834-acd1-df2c2c434dfa","Type":"ContainerStarted","Data":"f8fba958e68b0cdf7afe0c079084d0addb601749b826f510843ec8f7cd3a20ec"}
Jul 28 12:59:00.511109 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.511079    2567 generic.go:356] "Generic (PLEG): container finished" podID="57d0f186-5a36-4b9d-b0ff-621ba3080078" containerID="0900f1879e74cc45336e7c5730b5854bf1da06d1f1b70ab57c18b1d80c0bb17f" exitCode=0
Jul 28 12:59:00.511224 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.511159    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89" event={"ID":"57d0f186-5a36-4b9d-b0ff-621ba3080078","Type":"ContainerDied","Data":"0900f1879e74cc45336e7c5730b5854bf1da06d1f1b70ab57c18b1d80c0bb17f"}
Jul 28 12:59:00.513110 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.513085    2567 generic.go:356] "Generic (PLEG): container finished" podID="7387b635-9d62-43eb-91c6-26a2ccce613c" containerID="e95c9527ba378141ec1c8587afed5607041bf8e092bb14b9b325d8788bb42087" exitCode=0
Jul 28 12:59:00.513211 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.513173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69" event={"ID":"7387b635-9d62-43eb-91c6-26a2ccce613c","Type":"ContainerDied","Data":"e95c9527ba378141ec1c8587afed5607041bf8e092bb14b9b325d8788bb42087"}
Jul 28 12:59:00.513260 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.513222    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69" event={"ID":"7387b635-9d62-43eb-91c6-26a2ccce613c","Type":"ContainerStarted","Data":"e5df6088601857670f015629f6bd2378739565dd54ddeb0e95630d04fe8fdea4"}
Jul 28 12:59:00.537164 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:00.537013    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"]
Jul 28 12:59:00.554101 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:59:00.554074    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb582cfbb_baee_4a62_b902_0bf98c8e462d.slice/crio-46d19a6282e5e8ae692e9d78b783faa3973a09809df4e09d669ca7115f309b24 WatchSource:0}: Error finding container 46d19a6282e5e8ae692e9d78b783faa3973a09809df4e09d669ca7115f309b24: Status 404 returned error can't find the container with id 46d19a6282e5e8ae692e9d78b783faa3973a09809df4e09d669ca7115f309b24
Jul 28 12:59:01.519450 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:01.519417    2567 generic.go:356] "Generic (PLEG): container finished" podID="57d0f186-5a36-4b9d-b0ff-621ba3080078" containerID="3b4452dac41967d013bfd117cd20ed7d4b1e6e67a1077290de448b340cec6a13" exitCode=0
Jul 28 12:59:01.519903 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:01.519490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89" event={"ID":"57d0f186-5a36-4b9d-b0ff-621ba3080078","Type":"ContainerDied","Data":"3b4452dac41967d013bfd117cd20ed7d4b1e6e67a1077290de448b340cec6a13"}
Jul 28 12:59:01.520974 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:01.520951    2567 generic.go:356] "Generic (PLEG): container finished" podID="b582cfbb-baee-4a62-b902-0bf98c8e462d" containerID="b9ea76955c04a3a6bf37afe340c54fee5c8575787b2cb94017ab8bca598cfc95" exitCode=0
Jul 28 12:59:01.521068 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:01.521036    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx" event={"ID":"b582cfbb-baee-4a62-b902-0bf98c8e462d","Type":"ContainerDied","Data":"b9ea76955c04a3a6bf37afe340c54fee5c8575787b2cb94017ab8bca598cfc95"}
Jul 28 12:59:01.521107 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:01.521084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx" event={"ID":"b582cfbb-baee-4a62-b902-0bf98c8e462d","Type":"ContainerStarted","Data":"46d19a6282e5e8ae692e9d78b783faa3973a09809df4e09d669ca7115f309b24"}
Jul 28 12:59:02.528078 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.528044    2567 generic.go:356] "Generic (PLEG): container finished" podID="a6870421-30a2-4834-acd1-df2c2c434dfa" containerID="34ded1c0b2146bef543a6ba86b22f71ea29a1838ecd323f8093466168dd872b6" exitCode=0
Jul 28 12:59:02.528549 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.528131    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v" event={"ID":"a6870421-30a2-4834-acd1-df2c2c434dfa","Type":"ContainerDied","Data":"34ded1c0b2146bef543a6ba86b22f71ea29a1838ecd323f8093466168dd872b6"}
Jul 28 12:59:02.530149 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.530120    2567 generic.go:356] "Generic (PLEG): container finished" podID="7387b635-9d62-43eb-91c6-26a2ccce613c" containerID="450dff4c2ca0f421cc185c53d3cc5e447901cfff2af988c573dc714e8c6d09c3" exitCode=0
Jul 28 12:59:02.530238 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.530204    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69" event={"ID":"7387b635-9d62-43eb-91c6-26a2ccce613c","Type":"ContainerDied","Data":"450dff4c2ca0f421cc185c53d3cc5e447901cfff2af988c573dc714e8c6d09c3"}
Jul 28 12:59:02.532036 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.532012    2567 generic.go:356] "Generic (PLEG): container finished" podID="b582cfbb-baee-4a62-b902-0bf98c8e462d" containerID="d29bdea68dace75f2b971e6e771db4f8b739092d7ffcaa37f308f7a56dbbe000" exitCode=0
Jul 28 12:59:02.532133 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.532095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx" event={"ID":"b582cfbb-baee-4a62-b902-0bf98c8e462d","Type":"ContainerDied","Data":"d29bdea68dace75f2b971e6e771db4f8b739092d7ffcaa37f308f7a56dbbe000"}
Jul 28 12:59:02.672650 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.672621    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:59:02.682289 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.682257    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-util\") pod \"57d0f186-5a36-4b9d-b0ff-621ba3080078\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") "
Jul 28 12:59:02.682453 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.682321    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6thv\" (UniqueName: \"kubernetes.io/projected/57d0f186-5a36-4b9d-b0ff-621ba3080078-kube-api-access-d6thv\") pod \"57d0f186-5a36-4b9d-b0ff-621ba3080078\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") "
Jul 28 12:59:02.682453 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.682372    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-bundle\") pod \"57d0f186-5a36-4b9d-b0ff-621ba3080078\" (UID: \"57d0f186-5a36-4b9d-b0ff-621ba3080078\") "
Jul 28 12:59:02.683119 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.683080    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-bundle" (OuterVolumeSpecName: "bundle") pod "57d0f186-5a36-4b9d-b0ff-621ba3080078" (UID: "57d0f186-5a36-4b9d-b0ff-621ba3080078"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:59:02.685652 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.685618    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57d0f186-5a36-4b9d-b0ff-621ba3080078-kube-api-access-d6thv" (OuterVolumeSpecName: "kube-api-access-d6thv") pod "57d0f186-5a36-4b9d-b0ff-621ba3080078" (UID: "57d0f186-5a36-4b9d-b0ff-621ba3080078"). InnerVolumeSpecName "kube-api-access-d6thv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:59:02.689962 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.689885    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-util" (OuterVolumeSpecName: "util") pod "57d0f186-5a36-4b9d-b0ff-621ba3080078" (UID: "57d0f186-5a36-4b9d-b0ff-621ba3080078"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:59:02.783053 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.783029    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:02.783053 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.783052    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57d0f186-5a36-4b9d-b0ff-621ba3080078-util\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:02.783199 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:02.783061    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6thv\" (UniqueName: \"kubernetes.io/projected/57d0f186-5a36-4b9d-b0ff-621ba3080078-kube-api-access-d6thv\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:03.538383 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:03.538347    2567 generic.go:356] "Generic (PLEG): container finished" podID="a6870421-30a2-4834-acd1-df2c2c434dfa" containerID="bf3b4150c91cb21f7b76dc90389908e58e1f9223b795d79ace2a3c9d94b8242d" exitCode=0
Jul 28 12:59:03.538785 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:03.538422    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v" event={"ID":"a6870421-30a2-4834-acd1-df2c2c434dfa","Type":"ContainerDied","Data":"bf3b4150c91cb21f7b76dc90389908e58e1f9223b795d79ace2a3c9d94b8242d"}
Jul 28 12:59:03.540186 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:03.540168    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89"
Jul 28 12:59:03.540296 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:03.540167    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89" event={"ID":"57d0f186-5a36-4b9d-b0ff-621ba3080078","Type":"ContainerDied","Data":"79115e786195f838923aeecb323ba6cdb1fdcb048cb2646d53526e6f4ac71352"}
Jul 28 12:59:03.540296 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:03.540280    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79115e786195f838923aeecb323ba6cdb1fdcb048cb2646d53526e6f4ac71352"
Jul 28 12:59:03.542404 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:03.542379    2567 generic.go:356] "Generic (PLEG): container finished" podID="7387b635-9d62-43eb-91c6-26a2ccce613c" containerID="fe345f50e2dfc716ec47bc64748ac4054111f2f9609f6027833d467539590601" exitCode=0
Jul 28 12:59:03.542493 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:03.542411    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69" event={"ID":"7387b635-9d62-43eb-91c6-26a2ccce613c","Type":"ContainerDied","Data":"fe345f50e2dfc716ec47bc64748ac4054111f2f9609f6027833d467539590601"}
Jul 28 12:59:03.544602 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:03.544580    2567 generic.go:356] "Generic (PLEG): container finished" podID="b582cfbb-baee-4a62-b902-0bf98c8e462d" containerID="e16e6b733b373a431c38d10aeb7ac647039bd9b733e77e8c4d5ae586f30df727" exitCode=0
Jul 28 12:59:03.544696 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:03.544661    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx" event={"ID":"b582cfbb-baee-4a62-b902-0bf98c8e462d","Type":"ContainerDied","Data":"e16e6b733b373a431c38d10aeb7ac647039bd9b733e77e8c4d5ae586f30df727"}
Jul 28 12:59:04.694713 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.694687    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:59:04.721825 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.721801    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:59:04.734177 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.734155    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:04.795634 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.795605    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-util\") pod \"7387b635-9d62-43eb-91c6-26a2ccce613c\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") "
Jul 28 12:59:04.795822 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.795648    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qszqc\" (UniqueName: \"kubernetes.io/projected/b582cfbb-baee-4a62-b902-0bf98c8e462d-kube-api-access-qszqc\") pod \"b582cfbb-baee-4a62-b902-0bf98c8e462d\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") "
Jul 28 12:59:04.795822 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.795687    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfwzn\" (UniqueName: \"kubernetes.io/projected/a6870421-30a2-4834-acd1-df2c2c434dfa-kube-api-access-xfwzn\") pod \"a6870421-30a2-4834-acd1-df2c2c434dfa\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") "
Jul 28 12:59:04.795822 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.795703    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-bundle\") pod \"b582cfbb-baee-4a62-b902-0bf98c8e462d\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") "
Jul 28 12:59:04.795822 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.795732    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-util\") pod \"b582cfbb-baee-4a62-b902-0bf98c8e462d\" (UID: \"b582cfbb-baee-4a62-b902-0bf98c8e462d\") "
Jul 28 12:59:04.795822 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.795763    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-util\") pod \"a6870421-30a2-4834-acd1-df2c2c434dfa\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") "
Jul 28 12:59:04.795822 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.795808    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj8hs\" (UniqueName: \"kubernetes.io/projected/7387b635-9d62-43eb-91c6-26a2ccce613c-kube-api-access-gj8hs\") pod \"7387b635-9d62-43eb-91c6-26a2ccce613c\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") "
Jul 28 12:59:04.796151 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.795847    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-bundle\") pod \"7387b635-9d62-43eb-91c6-26a2ccce613c\" (UID: \"7387b635-9d62-43eb-91c6-26a2ccce613c\") "
Jul 28 12:59:04.796151 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.795879    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-bundle\") pod \"a6870421-30a2-4834-acd1-df2c2c434dfa\" (UID: \"a6870421-30a2-4834-acd1-df2c2c434dfa\") "
Jul 28 12:59:04.797120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.796265    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-bundle" (OuterVolumeSpecName: "bundle") pod "b582cfbb-baee-4a62-b902-0bf98c8e462d" (UID: "b582cfbb-baee-4a62-b902-0bf98c8e462d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:59:04.797120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.796787    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-bundle" (OuterVolumeSpecName: "bundle") pod "a6870421-30a2-4834-acd1-df2c2c434dfa" (UID: "a6870421-30a2-4834-acd1-df2c2c434dfa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:59:04.797120 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.797052    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-bundle" (OuterVolumeSpecName: "bundle") pod "7387b635-9d62-43eb-91c6-26a2ccce613c" (UID: "7387b635-9d62-43eb-91c6-26a2ccce613c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:59:04.798146 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.798110    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b582cfbb-baee-4a62-b902-0bf98c8e462d-kube-api-access-qszqc" (OuterVolumeSpecName: "kube-api-access-qszqc") pod "b582cfbb-baee-4a62-b902-0bf98c8e462d" (UID: "b582cfbb-baee-4a62-b902-0bf98c8e462d"). InnerVolumeSpecName "kube-api-access-qszqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:59:04.798146 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.798131    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6870421-30a2-4834-acd1-df2c2c434dfa-kube-api-access-xfwzn" (OuterVolumeSpecName: "kube-api-access-xfwzn") pod "a6870421-30a2-4834-acd1-df2c2c434dfa" (UID: "a6870421-30a2-4834-acd1-df2c2c434dfa"). InnerVolumeSpecName "kube-api-access-xfwzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:59:04.798476 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.798451    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7387b635-9d62-43eb-91c6-26a2ccce613c-kube-api-access-gj8hs" (OuterVolumeSpecName: "kube-api-access-gj8hs") pod "7387b635-9d62-43eb-91c6-26a2ccce613c" (UID: "7387b635-9d62-43eb-91c6-26a2ccce613c"). InnerVolumeSpecName "kube-api-access-gj8hs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:59:04.802309 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.802252    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-util" (OuterVolumeSpecName: "util") pod "b582cfbb-baee-4a62-b902-0bf98c8e462d" (UID: "b582cfbb-baee-4a62-b902-0bf98c8e462d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:59:04.804943 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.804899    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-util" (OuterVolumeSpecName: "util") pod "a6870421-30a2-4834-acd1-df2c2c434dfa" (UID: "a6870421-30a2-4834-acd1-df2c2c434dfa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:59:04.805087 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.805072    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-util" (OuterVolumeSpecName: "util") pod "7387b635-9d62-43eb-91c6-26a2ccce613c" (UID: "7387b635-9d62-43eb-91c6-26a2ccce613c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:59:04.831013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.830982    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:04.897290 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.897251    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj8hs\" (UniqueName: \"kubernetes.io/projected/7387b635-9d62-43eb-91c6-26a2ccce613c-kube-api-access-gj8hs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:04.897290 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.897295    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:04.897494 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.897309    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:04.897494 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.897316    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7387b635-9d62-43eb-91c6-26a2ccce613c-util\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:04.897494 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.897324    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qszqc\" (UniqueName: \"kubernetes.io/projected/b582cfbb-baee-4a62-b902-0bf98c8e462d-kube-api-access-qszqc\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:04.897494 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.897334    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfwzn\" (UniqueName: \"kubernetes.io/projected/a6870421-30a2-4834-acd1-df2c2c434dfa-kube-api-access-xfwzn\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:04.897494 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.897346    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-bundle\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:04.897494 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.897362    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b582cfbb-baee-4a62-b902-0bf98c8e462d-util\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:04.897494 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.897369    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6870421-30a2-4834-acd1-df2c2c434dfa-util\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:04.931952 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:04.931909    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:05.555939 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:05.555903    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v"
Jul 28 12:59:05.556112 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:05.555901    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v" event={"ID":"a6870421-30a2-4834-acd1-df2c2c434dfa","Type":"ContainerDied","Data":"f8fba958e68b0cdf7afe0c079084d0addb601749b826f510843ec8f7cd3a20ec"}
Jul 28 12:59:05.556112 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:05.556040    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8fba958e68b0cdf7afe0c079084d0addb601749b826f510843ec8f7cd3a20ec"
Jul 28 12:59:05.557908 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:05.557880    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69" event={"ID":"7387b635-9d62-43eb-91c6-26a2ccce613c","Type":"ContainerDied","Data":"e5df6088601857670f015629f6bd2378739565dd54ddeb0e95630d04fe8fdea4"}
Jul 28 12:59:05.558064 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:05.557971    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5df6088601857670f015629f6bd2378739565dd54ddeb0e95630d04fe8fdea4"
Jul 28 12:59:05.558064 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:05.557901    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69"
Jul 28 12:59:05.560137 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:05.560113    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx" event={"ID":"b582cfbb-baee-4a62-b902-0bf98c8e462d","Type":"ContainerDied","Data":"46d19a6282e5e8ae692e9d78b783faa3973a09809df4e09d669ca7115f309b24"}
Jul 28 12:59:05.560247 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:05.560152    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx"
Jul 28 12:59:05.560247 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:05.560152    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46d19a6282e5e8ae692e9d78b783faa3973a09809df4e09d669ca7115f309b24"
Jul 28 12:59:12.333610 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:12.333579    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:15.181142 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181105    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl"]
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181393    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7387b635-9d62-43eb-91c6-26a2ccce613c" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181403    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7387b635-9d62-43eb-91c6-26a2ccce613c" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181413    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d0f186-5a36-4b9d-b0ff-621ba3080078" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181419    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d0f186-5a36-4b9d-b0ff-621ba3080078" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181425    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b582cfbb-baee-4a62-b902-0bf98c8e462d" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181431    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b582cfbb-baee-4a62-b902-0bf98c8e462d" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181439    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6870421-30a2-4834-acd1-df2c2c434dfa" containerName="util"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181444    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6870421-30a2-4834-acd1-df2c2c434dfa" containerName="util"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181452    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7387b635-9d62-43eb-91c6-26a2ccce613c" containerName="util"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181457    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7387b635-9d62-43eb-91c6-26a2ccce613c" containerName="util"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181465    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d0f186-5a36-4b9d-b0ff-621ba3080078" containerName="util"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181470    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d0f186-5a36-4b9d-b0ff-621ba3080078" containerName="util"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181475    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b582cfbb-baee-4a62-b902-0bf98c8e462d" containerName="util"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181480    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b582cfbb-baee-4a62-b902-0bf98c8e462d" containerName="util"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181491    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b582cfbb-baee-4a62-b902-0bf98c8e462d" containerName="pull"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181495    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b582cfbb-baee-4a62-b902-0bf98c8e462d" containerName="pull"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181503    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57d0f186-5a36-4b9d-b0ff-621ba3080078" containerName="pull"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181507    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="57d0f186-5a36-4b9d-b0ff-621ba3080078" containerName="pull"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181513    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7387b635-9d62-43eb-91c6-26a2ccce613c" containerName="pull"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181517    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7387b635-9d62-43eb-91c6-26a2ccce613c" containerName="pull"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181523    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6870421-30a2-4834-acd1-df2c2c434dfa" containerName="pull"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181528    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6870421-30a2-4834-acd1-df2c2c434dfa" containerName="pull"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181534    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6870421-30a2-4834-acd1-df2c2c434dfa" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181539    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6870421-30a2-4834-acd1-df2c2c434dfa" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181582    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b582cfbb-baee-4a62-b902-0bf98c8e462d" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181591    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="57d0f186-5a36-4b9d-b0ff-621ba3080078" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181596    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7387b635-9d62-43eb-91c6-26a2ccce613c" containerName="extract"
Jul 28 12:59:15.181593 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.181604    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6870421-30a2-4834-acd1-df2c2c434dfa" containerName="extract"
Jul 28 12:59:15.187754 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.187694    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl"
Jul 28 12:59:15.190825 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.190801    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-gdhx6\""
Jul 28 12:59:15.198762 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.198743    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 28 12:59:15.205805 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.205781    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl"]
Jul 28 12:59:15.277850 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.277806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjrrd\" (UniqueName: \"kubernetes.io/projected/0822558b-d534-4819-9a01-d1f9c54605fc-kube-api-access-mjrrd\") pod \"dns-operator-controller-manager-864dd78c4c-gndgl\" (UID: \"0822558b-d534-4819-9a01-d1f9c54605fc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl"
Jul 28 12:59:15.379199 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.379160    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjrrd\" (UniqueName: \"kubernetes.io/projected/0822558b-d534-4819-9a01-d1f9c54605fc-kube-api-access-mjrrd\") pod \"dns-operator-controller-manager-864dd78c4c-gndgl\" (UID: \"0822558b-d534-4819-9a01-d1f9c54605fc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl"
Jul 28 12:59:15.395766 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.395734    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjrrd\" (UniqueName: \"kubernetes.io/projected/0822558b-d534-4819-9a01-d1f9c54605fc-kube-api-access-mjrrd\") pod \"dns-operator-controller-manager-864dd78c4c-gndgl\" (UID: \"0822558b-d534-4819-9a01-d1f9c54605fc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl"
Jul 28 12:59:15.497544 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.497450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl"
Jul 28 12:59:15.635411 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.635384    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl"]
Jul 28 12:59:15.637510 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:59:15.637476    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0822558b_d534_4819_9a01_d1f9c54605fc.slice/crio-2d572894111d7b029ae526b63ff4b57c1b08c02eb3c4186d91cfaae879ec6204 WatchSource:0}: Error finding container 2d572894111d7b029ae526b63ff4b57c1b08c02eb3c4186d91cfaae879ec6204: Status 404 returned error can't find the container with id 2d572894111d7b029ae526b63ff4b57c1b08c02eb3c4186d91cfaae879ec6204
Jul 28 12:59:15.834018 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.833987    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:15.946266 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:15.946237    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:16.044684 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:16.044652    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:16.537001 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:16.536967    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:16.616581 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:16.616543    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl" event={"ID":"0822558b-d534-4819-9a01-d1f9c54605fc","Type":"ContainerStarted","Data":"2d572894111d7b029ae526b63ff4b57c1b08c02eb3c4186d91cfaae879ec6204"}
Jul 28 12:59:18.312406 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.312369    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"]
Jul 28 12:59:18.315638 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.315620    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:18.318386 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.318361    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-z4rzd\""
Jul 28 12:59:18.329205 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.329179    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"]
Jul 28 12:59:18.405293 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.405252    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66kn8\" (UniqueName: \"kubernetes.io/projected/86ade1e7-d9f5-4a04-9fd5-dee24bb92072-kube-api-access-66kn8\") pod \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" (UID: \"86ade1e7-d9f5-4a04-9fd5-dee24bb92072\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:18.506130 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.506093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66kn8\" (UniqueName: \"kubernetes.io/projected/86ade1e7-d9f5-4a04-9fd5-dee24bb92072-kube-api-access-66kn8\") pod \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" (UID: \"86ade1e7-d9f5-4a04-9fd5-dee24bb92072\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:18.519013 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.518987    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66kn8\" (UniqueName: \"kubernetes.io/projected/86ade1e7-d9f5-4a04-9fd5-dee24bb92072-kube-api-access-66kn8\") pod \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" (UID: \"86ade1e7-d9f5-4a04-9fd5-dee24bb92072\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:18.625852 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.625751    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:18.629132 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.629101    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl" event={"ID":"0822558b-d534-4819-9a01-d1f9c54605fc","Type":"ContainerStarted","Data":"a61722fc35a7f77f52d24e98aa44ceabe366649d1c090cc90483672fed02d13e"}
Jul 28 12:59:18.629199 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.629171    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl"
Jul 28 12:59:18.650174 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.650114    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl" podStartSLOduration=1.509578284 podStartE2EDuration="3.650095296s" totalImagesPullingTime="2.140517012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:59:18.647865928 +0000 UTC m=+485.577149846" watchObservedRunningTime="2026-07-28 12:59:18.650095296 +0000 UTC m=+485.579379212"
Jul 28 12:59:18.772407 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.772383    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"]
Jul 28 12:59:18.774269 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:59:18.774243    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ade1e7_d9f5_4a04_9fd5_dee24bb92072.slice/crio-b9da9a017f886ee8b895a225def51c26820d95223e522a9d7c152a15b1269b59 WatchSource:0}: Error finding container b9da9a017f886ee8b895a225def51c26820d95223e522a9d7c152a15b1269b59: Status 404 returned error can't find the container with id b9da9a017f886ee8b895a225def51c26820d95223e522a9d7c152a15b1269b59
Jul 28 12:59:18.968536 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:18.968440    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:19.093745 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:19.093707    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:19.637388 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:19.637343    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt" event={"ID":"86ade1e7-d9f5-4a04-9fd5-dee24bb92072","Type":"ContainerStarted","Data":"b9da9a017f886ee8b895a225def51c26820d95223e522a9d7c152a15b1269b59"}
Jul 28 12:59:20.476854 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:20.476820    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:20.644715 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:20.644625    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt" event={"ID":"86ade1e7-d9f5-4a04-9fd5-dee24bb92072","Type":"ContainerStarted","Data":"d1e7c757b420930916f082a90f40493d3f5f7952634d36b3d6b338edc795db0b"}
Jul 28 12:59:20.644715 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:20.644691    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:20.675753 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:20.675699    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt" podStartSLOduration=1.112883209 podStartE2EDuration="2.675681279s" totalImagesPullingTime="1.56279807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:59:20.67542698 +0000 UTC m=+487.604710897" watchObservedRunningTime="2026-07-28 12:59:20.675681279 +0000 UTC m=+487.604965244"
Jul 28 12:59:23.480618 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.480578    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:23.505548 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.505517    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"]
Jul 28 12:59:23.509514 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.509492    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:23.513258 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.513240    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-76vmt\""
Jul 28 12:59:23.532829 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.532800    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"]
Jul 28 12:59:23.550210 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.550177    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q88cv\" (UniqueName: \"kubernetes.io/projected/4ced0b72-e344-4c0c-854b-22c36354c595-kube-api-access-q88cv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58692\" (UID: \"4ced0b72-e344-4c0c-854b-22c36354c595\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:23.550385 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.550223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ced0b72-e344-4c0c-854b-22c36354c595-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58692\" (UID: \"4ced0b72-e344-4c0c-854b-22c36354c595\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:23.651362 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.651321    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88cv\" (UniqueName: \"kubernetes.io/projected/4ced0b72-e344-4c0c-854b-22c36354c595-kube-api-access-q88cv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58692\" (UID: \"4ced0b72-e344-4c0c-854b-22c36354c595\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:23.651551 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.651381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ced0b72-e344-4c0c-854b-22c36354c595-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58692\" (UID: \"4ced0b72-e344-4c0c-854b-22c36354c595\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:23.651831 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.651809    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ced0b72-e344-4c0c-854b-22c36354c595-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58692\" (UID: \"4ced0b72-e344-4c0c-854b-22c36354c595\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:23.673019 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.672988    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q88cv\" (UniqueName: \"kubernetes.io/projected/4ced0b72-e344-4c0c-854b-22c36354c595-kube-api-access-q88cv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-58692\" (UID: \"4ced0b72-e344-4c0c-854b-22c36354c595\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:23.819680 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.819641    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:23.882297 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.882264    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:23.982384 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:23.982356    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"]
Jul 28 12:59:23.983654 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:59:23.983626    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ced0b72_e344_4c0c_854b_22c36354c595.slice/crio-fcdacfb18baad03978052c8befa55ee01b709e400e030bda47700e1fa731296a WatchSource:0}: Error finding container fcdacfb18baad03978052c8befa55ee01b709e400e030bda47700e1fa731296a: Status 404 returned error can't find the container with id fcdacfb18baad03978052c8befa55ee01b709e400e030bda47700e1fa731296a
Jul 28 12:59:24.183701 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:24.183609    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:24.663765 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:24.663734    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692" event={"ID":"4ced0b72-e344-4c0c-854b-22c36354c595","Type":"ContainerStarted","Data":"fcdacfb18baad03978052c8befa55ee01b709e400e030bda47700e1fa731296a"}
Jul 28 12:59:28.462757 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:28.462701    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:29.640449 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:29.640422    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gndgl"
Jul 28 12:59:29.694446 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:29.694399    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692" event={"ID":"4ced0b72-e344-4c0c-854b-22c36354c595","Type":"ContainerStarted","Data":"6c76fbe7f633f39740e5c8d48656ff766b047f7bec0c0d3ef3a267640b829bb7"}
Jul 28 12:59:29.694622 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:29.694477    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:29.789928 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:29.789859    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692" podStartSLOduration=2.012346062 podStartE2EDuration="6.789841764s" totalImagesPullingTime="4.777495702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:59:29.775327911 +0000 UTC m=+496.704611844" watchObservedRunningTime="2026-07-28 12:59:29.789841764 +0000 UTC m=+496.719125747"
Jul 28 12:59:30.365491 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:30.365450    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:30.519781 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:30.519745    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:31.652370 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.652342    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:31.717045 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.717011    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"]
Jul 28 12:59:31.721853 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.721830    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:31.726734 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.726709    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 28 12:59:31.726977 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.726960    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kwnnr\""
Jul 28 12:59:31.727114 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.727073    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 28 12:59:31.740331 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.740308    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"]
Jul 28 12:59:31.751345 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.751314    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:31.824086 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.824042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b736e1-6fa2-4c12-a4ef-9936d4dec9ab-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w58qr\" (UID: \"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:31.824268 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.824147    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2fjf\" (UniqueName: \"kubernetes.io/projected/85b736e1-6fa2-4c12-a4ef-9936d4dec9ab-kube-api-access-r2fjf\") pod \"kuadrant-console-plugin-66b5774985-w58qr\" (UID: \"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:31.824268 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.824214    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/85b736e1-6fa2-4c12-a4ef-9936d4dec9ab-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w58qr\" (UID: \"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:31.924915 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.924819    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b736e1-6fa2-4c12-a4ef-9936d4dec9ab-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w58qr\" (UID: \"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:31.924915 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.924867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2fjf\" (UniqueName: \"kubernetes.io/projected/85b736e1-6fa2-4c12-a4ef-9936d4dec9ab-kube-api-access-r2fjf\") pod \"kuadrant-console-plugin-66b5774985-w58qr\" (UID: \"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:31.925195 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.924997    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/85b736e1-6fa2-4c12-a4ef-9936d4dec9ab-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w58qr\" (UID: \"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:31.925668 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.925649    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/85b736e1-6fa2-4c12-a4ef-9936d4dec9ab-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-w58qr\" (UID: \"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:31.927376 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.927354    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/85b736e1-6fa2-4c12-a4ef-9936d4dec9ab-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-w58qr\" (UID: \"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:31.933737 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.933691    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2fjf\" (UniqueName: \"kubernetes.io/projected/85b736e1-6fa2-4c12-a4ef-9936d4dec9ab-kube-api-access-r2fjf\") pod \"kuadrant-console-plugin-66b5774985-w58qr\" (UID: \"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:31.983117 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:31.983065    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:32.033610 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:32.033575    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"
Jul 28 12:59:32.209866 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:32.209831    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr"]
Jul 28 12:59:32.211320 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:59:32.211295    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85b736e1_6fa2_4c12_a4ef_9936d4dec9ab.slice/crio-5269867dffd4eeb9d521b99617ddede2df4dd8df34fd994b95cabcf157364911 WatchSource:0}: Error finding container 5269867dffd4eeb9d521b99617ddede2df4dd8df34fd994b95cabcf157364911: Status 404 returned error can't find the container with id 5269867dffd4eeb9d521b99617ddede2df4dd8df34fd994b95cabcf157364911
Jul 28 12:59:32.709977 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:32.709943    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr" event={"ID":"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab","Type":"ContainerStarted","Data":"5269867dffd4eeb9d521b99617ddede2df4dd8df34fd994b95cabcf157364911"}
Jul 28 12:59:33.882048 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:33.882008    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:33.983558 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:33.983520    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:37.871693 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:37.871591    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:37.944354 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:37.944309    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:40.703189 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:40.703150    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:42.534183 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:42.534137    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:42.726936 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:42.726876    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:42.833821 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:42.833745    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"]
Jul 28 12:59:42.907892 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:42.907853    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"]
Jul 28 12:59:42.908101 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:42.907905    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"]
Jul 28 12:59:42.908101 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:42.907996    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:42.908223 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:42.908104    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" containerName="manager" containerID="cri-o://6c76fbe7f633f39740e5c8d48656ff766b047f7bec0c0d3ef3a267640b829bb7" gracePeriod=2
Jul 28 12:59:42.920407 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:42.920375    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"]
Jul 28 12:59:42.921598 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:42.921565    2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4ced0b72-e344-4c0c-854b-22c36354c595\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-58692\": pods \"kuadrant-operator-controller-manager-8684c9ff49-58692\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:42.947030 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:42.946996    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"]
Jul 28 12:59:42.947311 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:42.947284    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-hpxkk], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-hpxkk]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p" podUID="55d1e3aa-083e-4392-935d-09aadccf5a38"
Jul 28 12:59:42.982880 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:42.982849    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"]
Jul 28 12:59:43.002800 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.002762    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58692\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:43.006488 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.006455    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"]
Jul 28 12:59:43.006731 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.006695    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" containerName="manager" containerID="cri-o://d1e7c757b420930916f082a90f40493d3f5f7952634d36b3d6b338edc795db0b" gracePeriod=2
Jul 28 12:59:43.011602 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.011577    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"]
Jul 28 12:59:43.023056 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.023031    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"]
Jul 28 12:59:43.023401 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.023387    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" containerName="manager"
Jul 28 12:59:43.023449 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.023404    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" containerName="manager"
Jul 28 12:59:43.023449 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.023418    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" containerName="manager"
Jul 28 12:59:43.023449 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.023424    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" containerName="manager"
Jul 28 12:59:43.023550 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.023487    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" containerName="manager"
Jul 28 12:59:43.023550 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.023499    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" containerName="manager"
Jul 28 12:59:43.027667 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.027624    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58692\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:43.028026 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.028005    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 12:59:43.029732 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.029709    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpxkk\" (UniqueName: \"kubernetes.io/projected/55d1e3aa-083e-4392-935d-09aadccf5a38-kube-api-access-hpxkk\") pod \"kuadrant-operator-controller-manager-86878c769f-84z2p\" (UID: \"55d1e3aa-083e-4392-935d-09aadccf5a38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:43.029867 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.029847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d1e3aa-083e-4392-935d-09aadccf5a38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-84z2p\" (UID: \"55d1e3aa-083e-4392-935d-09aadccf5a38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:43.030650 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.030483    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:43.032602 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.032573    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58692\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:43.051882 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.051849    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"]
Jul 28 12:59:43.074080 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.074050    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s"]
Jul 28 12:59:43.079641 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.079606    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s"
Jul 28 12:59:43.082539 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.082508    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:43.085935 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.085842    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58692\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:43.102596 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.102560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s"]
Jul 28 12:59:43.130397 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.130361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d1e3aa-083e-4392-935d-09aadccf5a38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-84z2p\" (UID: \"55d1e3aa-083e-4392-935d-09aadccf5a38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:43.130603 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.130425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxkk\" (UniqueName: \"kubernetes.io/projected/55d1e3aa-083e-4392-935d-09aadccf5a38-kube-api-access-hpxkk\") pod \"kuadrant-operator-controller-manager-86878c769f-84z2p\" (UID: \"55d1e3aa-083e-4392-935d-09aadccf5a38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:43.130603 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.130461    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cwmr7\" (UID: \"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 12:59:43.130603 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.130492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n2hj\" (UniqueName: \"kubernetes.io/projected/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-kube-api-access-6n2hj\") pod \"kuadrant-operator-controller-manager-86878c769f-cwmr7\" (UID: \"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 12:59:43.130827 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.130807    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d1e3aa-083e-4392-935d-09aadccf5a38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-84z2p\" (UID: \"55d1e3aa-083e-4392-935d-09aadccf5a38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:43.136860 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.136613    2567 projected.go:196] Error preparing data for projected volume kube-api-access-hpxkk for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-84z2p" not found
Jul 28 12:59:43.136860 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.136686    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55d1e3aa-083e-4392-935d-09aadccf5a38-kube-api-access-hpxkk podName:55d1e3aa-083e-4392-935d-09aadccf5a38 nodeName:}" failed. No retries permitted until 2026-07-28 12:59:43.636666087 +0000 UTC m=+510.565949987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hpxkk" (UniqueName: "kubernetes.io/projected/55d1e3aa-083e-4392-935d-09aadccf5a38-kube-api-access-hpxkk") pod "kuadrant-operator-controller-manager-86878c769f-84z2p" (UID: "55d1e3aa-083e-4392-935d-09aadccf5a38") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-84z2p" not found
Jul 28 12:59:43.231392 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.231354    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cwmr7\" (UID: \"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 12:59:43.231392 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.231391    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n2hj\" (UniqueName: \"kubernetes.io/projected/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-kube-api-access-6n2hj\") pod \"kuadrant-operator-controller-manager-86878c769f-cwmr7\" (UID: \"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 12:59:43.231638 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.231415    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr668\" (UniqueName: \"kubernetes.io/projected/4a640983-f718-4fda-a711-d42d3ec5a0e0-kube-api-access-wr668\") pod \"limitador-operator-controller-manager-859d7b78bd-8j84s\" (UID: \"4a640983-f718-4fda-a711-d42d3ec5a0e0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s"
Jul 28 12:59:43.231831 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.231801    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-cwmr7\" (UID: \"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 12:59:43.260061 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.260032    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n2hj\" (UniqueName: \"kubernetes.io/projected/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-kube-api-access-6n2hj\") pod \"kuadrant-operator-controller-manager-86878c769f-cwmr7\" (UID: \"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 12:59:43.332409 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.332016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr668\" (UniqueName: \"kubernetes.io/projected/4a640983-f718-4fda-a711-d42d3ec5a0e0-kube-api-access-wr668\") pod \"limitador-operator-controller-manager-859d7b78bd-8j84s\" (UID: \"4a640983-f718-4fda-a711-d42d3ec5a0e0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s"
Jul 28 12:59:43.346617 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.346544    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr668\" (UniqueName: \"kubernetes.io/projected/4a640983-f718-4fda-a711-d42d3ec5a0e0-kube-api-access-wr668\") pod \"limitador-operator-controller-manager-859d7b78bd-8j84s\" (UID: \"4a640983-f718-4fda-a711-d42d3ec5a0e0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s"
Jul 28 12:59:43.377354 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.377321    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 12:59:43.391273 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.391248    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s"
Jul 28 12:59:43.500451 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.500409    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:43.503207 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.503174    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58692\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:43.736186 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.736099    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpxkk\" (UniqueName: \"kubernetes.io/projected/55d1e3aa-083e-4392-935d-09aadccf5a38-kube-api-access-hpxkk\") pod \"kuadrant-operator-controller-manager-86878c769f-84z2p\" (UID: \"55d1e3aa-083e-4392-935d-09aadccf5a38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:43.739317 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.739291    2567 projected.go:196] Error preparing data for projected volume kube-api-access-hpxkk for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-84z2p" not found
Jul 28 12:59:43.739454 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.739389    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55d1e3aa-083e-4392-935d-09aadccf5a38-kube-api-access-hpxkk podName:55d1e3aa-083e-4392-935d-09aadccf5a38 nodeName:}" failed. No retries permitted until 2026-07-28 12:59:44.739365119 +0000 UTC m=+511.668649017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpxkk" (UniqueName: "kubernetes.io/projected/55d1e3aa-083e-4392-935d-09aadccf5a38-kube-api-access-hpxkk") pod "kuadrant-operator-controller-manager-86878c769f-84z2p" (UID: "55d1e3aa-083e-4392-935d-09aadccf5a38") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-84z2p" not found
Jul 28 12:59:43.778940 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.778902    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:43.800150 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.800120    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:43.802783 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:43.802742    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-84z2p\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="55d1e3aa-083e-4392-935d-09aadccf5a38" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:43.938428 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.938396    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d1e3aa-083e-4392-935d-09aadccf5a38-extensions-socket-volume\") pod \"55d1e3aa-083e-4392-935d-09aadccf5a38\" (UID: \"55d1e3aa-083e-4392-935d-09aadccf5a38\") "
Jul 28 12:59:43.938708 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.938691    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpxkk\" (UniqueName: \"kubernetes.io/projected/55d1e3aa-083e-4392-935d-09aadccf5a38-kube-api-access-hpxkk\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:43.938747 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:43.938691    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55d1e3aa-083e-4392-935d-09aadccf5a38-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "55d1e3aa-083e-4392-935d-09aadccf5a38" (UID: "55d1e3aa-083e-4392-935d-09aadccf5a38"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:59:44.039431 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:44.039396    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55d1e3aa-083e-4392-935d-09aadccf5a38-extensions-socket-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:44.784824 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:44.784777    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:44.787494 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:44.787450    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-84z2p\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="55d1e3aa-083e-4392-935d-09aadccf5a38" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:44.793677 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:44.793645    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-84z2p\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="55d1e3aa-083e-4392-935d-09aadccf5a38" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84z2p"
Jul 28 12:59:45.501533 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:45.501488    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55d1e3aa-083e-4392-935d-09aadccf5a38" path="/var/lib/kubelet/pods/55d1e3aa-083e-4392-935d-09aadccf5a38/volumes"
Jul 28 12:59:46.539304 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:46.539268    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:46.639051 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:46.639017    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:49.109224 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:49.109188    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:49.212528 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:49.212497    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:51.942476 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:51.942402    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:52.044636 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:52.044593    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:53.718559 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:53.718489    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s"]
Jul 28 12:59:53.723229 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:59:53.723186    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a640983_f718_4fda_a711_d42d3ec5a0e0.slice/crio-0afc44218ca80eef269288afe93afb31eb3036e95b665fdcaeb02ed5f655a328 WatchSource:0}: Error finding container 0afc44218ca80eef269288afe93afb31eb3036e95b665fdcaeb02ed5f655a328: Status 404 returned error can't find the container with id 0afc44218ca80eef269288afe93afb31eb3036e95b665fdcaeb02ed5f655a328
Jul 28 12:59:53.735650 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:53.735627    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"]
Jul 28 12:59:53.737689 ip-10-0-133-173 kubenswrapper[2567]: W0728 12:59:53.737663    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73fa203e_6d6d_42f1_9a6d_ebbc5924d9de.slice/crio-8e3111c55ca978d6f0e8d02cd28c4d35576dfee96fa0a592fd60c9c577d69b35 WatchSource:0}: Error finding container 8e3111c55ca978d6f0e8d02cd28c4d35576dfee96fa0a592fd60c9c577d69b35: Status 404 returned error can't find the container with id 8e3111c55ca978d6f0e8d02cd28c4d35576dfee96fa0a592fd60c9c577d69b35
Jul 28 12:59:53.834914 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:53.834837    2567 generic.go:356] "Generic (PLEG): container finished" podID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" containerID="d1e7c757b420930916f082a90f40493d3f5f7952634d36b3d6b338edc795db0b" exitCode=0
Jul 28 12:59:53.836355 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:53.836332    2567 generic.go:356] "Generic (PLEG): container finished" podID="4ced0b72-e344-4c0c-854b-22c36354c595" containerID="6c76fbe7f633f39740e5c8d48656ff766b047f7bec0c0d3ef3a267640b829bb7" exitCode=0
Jul 28 12:59:53.837541 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:53.837519    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7" event={"ID":"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de","Type":"ContainerStarted","Data":"8e3111c55ca978d6f0e8d02cd28c4d35576dfee96fa0a592fd60c9c577d69b35"}
Jul 28 12:59:53.838599 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:53.838578    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s" event={"ID":"4a640983-f718-4fda-a711-d42d3ec5a0e0","Type":"ContainerStarted","Data":"0afc44218ca80eef269288afe93afb31eb3036e95b665fdcaeb02ed5f655a328"}
Jul 28 12:59:53.978538 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:53.978499    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:53.980846 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:53.980818    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:53.994717 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:53.994681    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:53.997186 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:53.997160    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:54.000661 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:54.000632    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58692\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:54.130138 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.130099    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ced0b72-e344-4c0c-854b-22c36354c595-extensions-socket-volume\") pod \"4ced0b72-e344-4c0c-854b-22c36354c595\" (UID: \"4ced0b72-e344-4c0c-854b-22c36354c595\") "
Jul 28 12:59:54.130338 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.130182    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66kn8\" (UniqueName: \"kubernetes.io/projected/86ade1e7-d9f5-4a04-9fd5-dee24bb92072-kube-api-access-66kn8\") pod \"86ade1e7-d9f5-4a04-9fd5-dee24bb92072\" (UID: \"86ade1e7-d9f5-4a04-9fd5-dee24bb92072\") "
Jul 28 12:59:54.130338 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.130246    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q88cv\" (UniqueName: \"kubernetes.io/projected/4ced0b72-e344-4c0c-854b-22c36354c595-kube-api-access-q88cv\") pod \"4ced0b72-e344-4c0c-854b-22c36354c595\" (UID: \"4ced0b72-e344-4c0c-854b-22c36354c595\") "
Jul 28 12:59:54.130776 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.130653    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ced0b72-e344-4c0c-854b-22c36354c595-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4ced0b72-e344-4c0c-854b-22c36354c595" (UID: "4ced0b72-e344-4c0c-854b-22c36354c595"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 12:59:54.132607 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.132559    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86ade1e7-d9f5-4a04-9fd5-dee24bb92072-kube-api-access-66kn8" (OuterVolumeSpecName: "kube-api-access-66kn8") pod "86ade1e7-d9f5-4a04-9fd5-dee24bb92072" (UID: "86ade1e7-d9f5-4a04-9fd5-dee24bb92072"). InnerVolumeSpecName "kube-api-access-66kn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:59:54.132745 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.132710    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ced0b72-e344-4c0c-854b-22c36354c595-kube-api-access-q88cv" (OuterVolumeSpecName: "kube-api-access-q88cv") pod "4ced0b72-e344-4c0c-854b-22c36354c595" (UID: "4ced0b72-e344-4c0c-854b-22c36354c595"). InnerVolumeSpecName "kube-api-access-q88cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 12:59:54.231757 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.231707    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q88cv\" (UniqueName: \"kubernetes.io/projected/4ced0b72-e344-4c0c-854b-22c36354c595-kube-api-access-q88cv\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:54.231757 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.231738    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4ced0b72-e344-4c0c-854b-22c36354c595-extensions-socket-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:54.231757 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.231748    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66kn8\" (UniqueName: \"kubernetes.io/projected/86ade1e7-d9f5-4a04-9fd5-dee24bb92072-kube-api-access-66kn8\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 12:59:54.846195 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.846095    2567 scope.go:117] "RemoveContainer" containerID="d1e7c757b420930916f082a90f40493d3f5f7952634d36b3d6b338edc795db0b"
Jul 28 12:59:54.846195 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.846103    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:54.847758 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.847730    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:54.848741 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:54.848704    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:54.849556 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.849529    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr" event={"ID":"85b736e1-6fa2-4c12-a4ef-9936d4dec9ab","Type":"ContainerStarted","Data":"efb9e8e8138c39e70f595eb41e4c04c159a42a13ce69f3027d17a1973de54c0a"}
Jul 28 12:59:54.851067 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:54.851042    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58692\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:54.851524 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.851497    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7" event={"ID":"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de","Type":"ContainerStarted","Data":"a851fbbcd122a550143608654532c91649134a24ee6b635ee5be8e7712cf9036"}
Jul 28 12:59:54.851624 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.851555    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 12:59:54.853384 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.853359    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s" event={"ID":"4a640983-f718-4fda-a711-d42d3ec5a0e0","Type":"ContainerStarted","Data":"17b82f85538f9bf10b0106f2efb2b83c52b4af3764b8c4dc8f32a8a3a8c17ecc"}
Jul 28 12:59:54.853494 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.853411    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s"
Jul 28 12:59:54.853562 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:54.853497    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:54.855694 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:54.855665    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58692\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:54.858573 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.858547    2567 scope.go:117] "RemoveContainer" containerID="6c76fbe7f633f39740e5c8d48656ff766b047f7bec0c0d3ef3a267640b829bb7"
Jul 28 12:59:54.879021 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:54.878987    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ade1e7_d9f5_4a04_9fd5_dee24bb92072.slice\": RecentStats: unable to find data in memory cache]"
Jul 28 12:59:54.887166 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:54.882649    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-k9sbt\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-k9sbt"
Jul 28 12:59:54.887166 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.884397    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-w58qr" podStartSLOduration=2.072021743 podStartE2EDuration="23.884376776s" totalImagesPullingTime="21.812355033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:59:54.880018789 +0000 UTC m=+521.809302706" watchObservedRunningTime="2026-07-28 12:59:54.884376776 +0000 UTC m=+521.813660697"
Jul 28 12:59:54.887166 ip-10-0-133-173 kubenswrapper[2567]: E0728 12:59:54.886127    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-58692\" is forbidden: User \"system:node:ip-10-0-133-173.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-173.ec2.internal' and this object" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-58692"
Jul 28 12:59:54.905353 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.905299    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s" podStartSLOduration=11.905280207 podStartE2EDuration="11.905280207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:59:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:59:54.903899487 +0000 UTC m=+521.833183403" watchObservedRunningTime="2026-07-28 12:59:54.905280207 +0000 UTC m=+521.834564123"
Jul 28 12:59:54.924067 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:54.924015    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7" podStartSLOduration=12.923997821 podStartE2EDuration="12.923997821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 12:59:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 12:59:54.923331641 +0000 UTC m=+521.852615584" watchObservedRunningTime="2026-07-28 12:59:54.923997821 +0000 UTC m=+521.853281798"
Jul 28 12:59:55.500540 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:55.500502    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ced0b72-e344-4c0c-854b-22c36354c595" path="/var/lib/kubelet/pods/4ced0b72-e344-4c0c-854b-22c36354c595/volumes"
Jul 28 12:59:55.500823 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:55.500811    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86ade1e7-d9f5-4a04-9fd5-dee24bb92072" path="/var/lib/kubelet/pods/86ade1e7-d9f5-4a04-9fd5-dee24bb92072/volumes"
Jul 28 12:59:55.536050 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:55.536008    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 12:59:55.629083 ip-10-0-133-173 kubenswrapper[2567]: I0728 12:59:55.629052    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:04.113286 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:04.113247    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:04.228096 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:04.228058    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:04.766738 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:04.766706    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:04.914397 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:04.914363    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:05.863600 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:05.863565    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8j84s"
Jul 28 13:00:05.864032 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:05.863737    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 13:00:07.351633 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:07.351593    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:07.545106 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:07.545067    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:08.587089 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:08.587045    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:10.428545 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:10.428513    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:10.533659 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:10.533628    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:11.840522 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:11.840486    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:14.049272 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:14.049232    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:14.193376 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:14.193337    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:22.590213 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.590181    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"]
Jul 28 13:00:22.605907 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.605878    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.608280 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.608250    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"]
Jul 28 13:00:22.608594 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.608558    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jcxkq\""
Jul 28 13:00:22.617455 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.617420    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:22.678340 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.678298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.678340 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.678342    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da01587a-958c-4fa8-858c-8baae2332d54-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.678569 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.678363    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da01587a-958c-4fa8-858c-8baae2332d54-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.678569 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.678447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsjk7\" (UniqueName: \"kubernetes.io/projected/da01587a-958c-4fa8-858c-8baae2332d54-kube-api-access-vsjk7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.678569 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.678493    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da01587a-958c-4fa8-858c-8baae2332d54-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.678569 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.678544    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.678724 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.678585    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.678724 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.678602    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.678724 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.678624    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779290 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779290 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da01587a-958c-4fa8-858c-8baae2332d54-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779544 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da01587a-958c-4fa8-858c-8baae2332d54-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779544 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsjk7\" (UniqueName: \"kubernetes.io/projected/da01587a-958c-4fa8-858c-8baae2332d54-kube-api-access-vsjk7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779544 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779400    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da01587a-958c-4fa8-858c-8baae2332d54-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779544 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779436    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779544 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779496    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779544 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779521    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779842 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779558    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779842 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779735    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779995 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779849    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.779995 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779897    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.780110 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.779988    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.780301 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.780279    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da01587a-958c-4fa8-858c-8baae2332d54-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.781814 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.781782    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da01587a-958c-4fa8-858c-8baae2332d54-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.781988 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.781972    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da01587a-958c-4fa8-858c-8baae2332d54-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.783747 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.783716    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:22.787679 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.787655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da01587a-958c-4fa8-858c-8baae2332d54-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.787897 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.787874    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsjk7\" (UniqueName: \"kubernetes.io/projected/da01587a-958c-4fa8-858c-8baae2332d54-kube-api-access-vsjk7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zk8s8\" (UID: \"da01587a-958c-4fa8-858c-8baae2332d54\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:22.918163 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:22.918065    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:23.059090 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:23.059064    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"]
Jul 28 13:00:23.061304 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:00:23.061275    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda01587a_958c_4fa8_858c_8baae2332d54.slice/crio-2d12e0deb37c1f56f31fdddd19526e823ea3a10c6bc31b1ce71196190b55efa1 WatchSource:0}: Error finding container 2d12e0deb37c1f56f31fdddd19526e823ea3a10c6bc31b1ce71196190b55efa1: Status 404 returned error can't find the container with id 2d12e0deb37c1f56f31fdddd19526e823ea3a10c6bc31b1ce71196190b55efa1
Jul 28 13:00:23.063237 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:23.063209    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:00:23.063330 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:23.063271    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:00:23.063330 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:23.063299    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:00:23.208946 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:23.208838    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:23.308209 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:23.308172    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:24.012461 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:24.012417    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" event={"ID":"da01587a-958c-4fa8-858c-8baae2332d54","Type":"ContainerStarted","Data":"5cc3129ad44d8630104ed3a1dd786ed7d563919334ef1f206f60480b9cb69f21"}
Jul 28 13:00:24.012888 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:24.012509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" event={"ID":"da01587a-958c-4fa8-858c-8baae2332d54","Type":"ContainerStarted","Data":"2d12e0deb37c1f56f31fdddd19526e823ea3a10c6bc31b1ce71196190b55efa1"}
Jul 28 13:00:24.035654 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:24.035593    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" podStartSLOduration=2.035578991 podStartE2EDuration="2.035578991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:00:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:00:24.033803416 +0000 UTC m=+550.963087326" watchObservedRunningTime="2026-07-28 13:00:24.035578991 +0000 UTC m=+550.964862907"
Jul 28 13:00:24.919120 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:24.919080    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:24.924156 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:24.924096    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:25.017891 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:25.017859    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:25.018959 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:25.018932    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:00:25.279947 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:25.279901    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:25.373131 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:25.373079    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:25.481068 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:25.481033    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:26.165394 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.165354    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-bmllb"]
Jul 28 13:00:26.208151 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.208113    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bmllb"]
Jul 28 13:00:26.208344 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.208235    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bmllb"
Jul 28 13:00:26.208662 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.208623    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:26.211885 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.211868    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-k5pcm\""
Jul 28 13:00:26.305965 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.305903    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:26.314053 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.314021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6srds\" (UniqueName: \"kubernetes.io/projected/93c5f5ef-174f-4ca3-80dc-afb85437e034-kube-api-access-6srds\") pod \"authorino-58cd955675-bmllb\" (UID: \"93c5f5ef-174f-4ca3-80dc-afb85437e034\") " pod="kuadrant-system/authorino-58cd955675-bmllb"
Jul 28 13:00:26.415332 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.415283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6srds\" (UniqueName: \"kubernetes.io/projected/93c5f5ef-174f-4ca3-80dc-afb85437e034-kube-api-access-6srds\") pod \"authorino-58cd955675-bmllb\" (UID: \"93c5f5ef-174f-4ca3-80dc-afb85437e034\") " pod="kuadrant-system/authorino-58cd955675-bmllb"
Jul 28 13:00:26.429058 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.428986    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6srds\" (UniqueName: \"kubernetes.io/projected/93c5f5ef-174f-4ca3-80dc-afb85437e034-kube-api-access-6srds\") pod \"authorino-58cd955675-bmllb\" (UID: \"93c5f5ef-174f-4ca3-80dc-afb85437e034\") " pod="kuadrant-system/authorino-58cd955675-bmllb"
Jul 28 13:00:26.469727 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.469689    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8c5n6"]
Jul 28 13:00:26.475241 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.475220    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8c5n6"
Jul 28 13:00:26.490538 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.490513    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8c5n6"]
Jul 28 13:00:26.518078 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.518047    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bmllb"
Jul 28 13:00:26.617646 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.617612    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9lx4\" (UniqueName: \"kubernetes.io/projected/fc880b72-7a5b-473a-9ee6-9482c6622565-kube-api-access-x9lx4\") pod \"authorino-75d556bd77-8c5n6\" (UID: \"fc880b72-7a5b-473a-9ee6-9482c6622565\") " pod="kuadrant-system/authorino-75d556bd77-8c5n6"
Jul 28 13:00:26.658736 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.658706    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bmllb"]
Jul 28 13:00:26.660759 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:00:26.660731    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93c5f5ef_174f_4ca3_80dc_afb85437e034.slice/crio-a8e09a12e9ca6c7ecf0ca00722c7526b0b459a8db7ba77bdfabfab6f3e21ff2d WatchSource:0}: Error finding container a8e09a12e9ca6c7ecf0ca00722c7526b0b459a8db7ba77bdfabfab6f3e21ff2d: Status 404 returned error can't find the container with id a8e09a12e9ca6c7ecf0ca00722c7526b0b459a8db7ba77bdfabfab6f3e21ff2d
Jul 28 13:00:26.718795 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.718705    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9lx4\" (UniqueName: \"kubernetes.io/projected/fc880b72-7a5b-473a-9ee6-9482c6622565-kube-api-access-x9lx4\") pod \"authorino-75d556bd77-8c5n6\" (UID: \"fc880b72-7a5b-473a-9ee6-9482c6622565\") " pod="kuadrant-system/authorino-75d556bd77-8c5n6"
Jul 28 13:00:26.728694 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.728665    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9lx4\" (UniqueName: \"kubernetes.io/projected/fc880b72-7a5b-473a-9ee6-9482c6622565-kube-api-access-x9lx4\") pod \"authorino-75d556bd77-8c5n6\" (UID: \"fc880b72-7a5b-473a-9ee6-9482c6622565\") " pod="kuadrant-system/authorino-75d556bd77-8c5n6"
Jul 28 13:00:26.784797 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.784757    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8c5n6"
Jul 28 13:00:26.920528 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:26.920492    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8c5n6"]
Jul 28 13:00:26.923496 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:00:26.923472    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc880b72_7a5b_473a_9ee6_9482c6622565.slice/crio-15654b4077b0ff29654d491c01f4e739b15e8aff6d75eb85c9698762522a3feb WatchSource:0}: Error finding container 15654b4077b0ff29654d491c01f4e739b15e8aff6d75eb85c9698762522a3feb: Status 404 returned error can't find the container with id 15654b4077b0ff29654d491c01f4e739b15e8aff6d75eb85c9698762522a3feb
Jul 28 13:00:27.030466 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:27.029393    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8c5n6" event={"ID":"fc880b72-7a5b-473a-9ee6-9482c6622565","Type":"ContainerStarted","Data":"15654b4077b0ff29654d491c01f4e739b15e8aff6d75eb85c9698762522a3feb"}
Jul 28 13:00:27.036397 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:27.036360    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bmllb" event={"ID":"93c5f5ef-174f-4ca3-80dc-afb85437e034","Type":"ContainerStarted","Data":"a8e09a12e9ca6c7ecf0ca00722c7526b0b459a8db7ba77bdfabfab6f3e21ff2d"}
Jul 28 13:00:31.067893 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:31.067859    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8c5n6" event={"ID":"fc880b72-7a5b-473a-9ee6-9482c6622565","Type":"ContainerStarted","Data":"77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429"}
Jul 28 13:00:31.069498 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:31.069471    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bmllb" event={"ID":"93c5f5ef-174f-4ca3-80dc-afb85437e034","Type":"ContainerStarted","Data":"757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f"}
Jul 28 13:00:31.090537 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:31.090483    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8c5n6" podStartSLOduration=1.639369482 podStartE2EDuration="5.090467885s" totalImagesPullingTime="3.451098403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:00:31.088016815 +0000 UTC m=+558.017300732" watchObservedRunningTime="2026-07-28 13:00:31.090467885 +0000 UTC m=+558.019751801"
Jul 28 13:00:31.112846 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:31.112795    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-bmllb" podStartSLOduration=1.4111060819999999 podStartE2EDuration="5.112776659s" totalImagesPullingTime="3.701670577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:00:31.110901887 +0000 UTC m=+558.040185805" watchObservedRunningTime="2026-07-28 13:00:31.112776659 +0000 UTC m=+558.042060575"
Jul 28 13:00:31.154125 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:31.154093    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bmllb"]
Jul 28 13:00:33.078984 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:33.078935    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-bmllb" podUID="93c5f5ef-174f-4ca3-80dc-afb85437e034" containerName="authorino" containerID="cri-o://757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f" gracePeriod=30
Jul 28 13:00:33.326883 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:33.326854    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bmllb"
Jul 28 13:00:33.483249 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:33.483150    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6srds\" (UniqueName: \"kubernetes.io/projected/93c5f5ef-174f-4ca3-80dc-afb85437e034-kube-api-access-6srds\") pod \"93c5f5ef-174f-4ca3-80dc-afb85437e034\" (UID: \"93c5f5ef-174f-4ca3-80dc-afb85437e034\") "
Jul 28 13:00:33.485346 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:33.485321    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c5f5ef-174f-4ca3-80dc-afb85437e034-kube-api-access-6srds" (OuterVolumeSpecName: "kube-api-access-6srds") pod "93c5f5ef-174f-4ca3-80dc-afb85437e034" (UID: "93c5f5ef-174f-4ca3-80dc-afb85437e034"). InnerVolumeSpecName "kube-api-access-6srds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:00:33.584642 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:33.584607    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6srds\" (UniqueName: \"kubernetes.io/projected/93c5f5ef-174f-4ca3-80dc-afb85437e034-kube-api-access-6srds\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:00:34.085367 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:34.085330    2567 generic.go:356] "Generic (PLEG): container finished" podID="93c5f5ef-174f-4ca3-80dc-afb85437e034" containerID="757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f" exitCode=0
Jul 28 13:00:34.085796 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:34.085377    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bmllb"
Jul 28 13:00:34.085796 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:34.085417    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bmllb" event={"ID":"93c5f5ef-174f-4ca3-80dc-afb85437e034","Type":"ContainerDied","Data":"757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f"}
Jul 28 13:00:34.085796 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:34.085464    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bmllb" event={"ID":"93c5f5ef-174f-4ca3-80dc-afb85437e034","Type":"ContainerDied","Data":"a8e09a12e9ca6c7ecf0ca00722c7526b0b459a8db7ba77bdfabfab6f3e21ff2d"}
Jul 28 13:00:34.085796 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:34.085478    2567 scope.go:117] "RemoveContainer" containerID="757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f"
Jul 28 13:00:34.094181 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:34.094143    2567 scope.go:117] "RemoveContainer" containerID="757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f"
Jul 28 13:00:34.100415 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:00:34.100382    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f\": container with ID starting with 757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f not found: ID does not exist" containerID="757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f"
Jul 28 13:00:34.100579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:34.100424    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f"} err="failed to get container status \"757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f\": rpc error: code = NotFound desc = could not find container \"757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f\": container with ID starting with 757a41039e90ce62e5bce9aa0c194a0e7bc3cac972fa660016caed75ffde596f not found: ID does not exist"
Jul 28 13:00:34.103942 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:34.103893    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bmllb"]
Jul 28 13:00:34.107088 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:34.107062    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-bmllb"]
Jul 28 13:00:35.501540 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:35.501508    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c5f5ef-174f-4ca3-80dc-afb85437e034" path="/var/lib/kubelet/pods/93c5f5ef-174f-4ca3-80dc-afb85437e034/volumes"
Jul 28 13:00:46.611584 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:46.611539    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:46.709765 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:46.709725    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:47.280949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:47.280889    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:48.238881 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:48.238842    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:48.338900 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:48.338864    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:59.456214 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.456170    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:59.715412 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.715312    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f7ssb"]
Jul 28 13:00:59.715647 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.715631    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c5f5ef-174f-4ca3-80dc-afb85437e034" containerName="authorino"
Jul 28 13:00:59.715712 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.715650    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c5f5ef-174f-4ca3-80dc-afb85437e034" containerName="authorino"
Jul 28 13:00:59.715797 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.715719    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c5f5ef-174f-4ca3-80dc-afb85437e034" containerName="authorino"
Jul 28 13:00:59.719937 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.719907    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f7ssb"
Jul 28 13:00:59.728120 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.728093    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f7ssb"]
Jul 28 13:00:59.816424 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.816392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9phqv\" (UniqueName: \"kubernetes.io/projected/d344ed25-a45d-4424-9cfe-6c05b320adaf-kube-api-access-9phqv\") pod \"authorino-5d4b67c446-f7ssb\" (UID: \"d344ed25-a45d-4424-9cfe-6c05b320adaf\") " pod="kuadrant-system/authorino-5d4b67c446-f7ssb"
Jul 28 13:00:59.912267 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.912226    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:00:59.917234 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.917198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phqv\" (UniqueName: \"kubernetes.io/projected/d344ed25-a45d-4424-9cfe-6c05b320adaf-kube-api-access-9phqv\") pod \"authorino-5d4b67c446-f7ssb\" (UID: \"d344ed25-a45d-4424-9cfe-6c05b320adaf\") " pod="kuadrant-system/authorino-5d4b67c446-f7ssb"
Jul 28 13:00:59.926037 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:00:59.926010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9phqv\" (UniqueName: \"kubernetes.io/projected/d344ed25-a45d-4424-9cfe-6c05b320adaf-kube-api-access-9phqv\") pod \"authorino-5d4b67c446-f7ssb\" (UID: \"d344ed25-a45d-4424-9cfe-6c05b320adaf\") " pod="kuadrant-system/authorino-5d4b67c446-f7ssb"
Jul 28 13:01:00.029838 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.029804    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f7ssb"
Jul 28 13:01:00.054738 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.054708    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f7ssb"]
Jul 28 13:01:00.085694 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.085647    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f67f45676-z6rnl"]
Jul 28 13:01:00.090907 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.090882    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f67f45676-z6rnl"
Jul 28 13:01:00.095668 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.095440    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 13:01:00.098669 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.098635    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f67f45676-z6rnl"]
Jul 28 13:01:00.119288 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.119257    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd0d8831-b6a8-476a-b741-307315022d2c-tls-cert\") pod \"authorino-7f67f45676-z6rnl\" (UID: \"fd0d8831-b6a8-476a-b741-307315022d2c\") " pod="kuadrant-system/authorino-7f67f45676-z6rnl"
Jul 28 13:01:00.119473 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.119434    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cn5q\" (UniqueName: \"kubernetes.io/projected/fd0d8831-b6a8-476a-b741-307315022d2c-kube-api-access-9cn5q\") pod \"authorino-7f67f45676-z6rnl\" (UID: \"fd0d8831-b6a8-476a-b741-307315022d2c\") " pod="kuadrant-system/authorino-7f67f45676-z6rnl"
Jul 28 13:01:00.182106 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.182080    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f7ssb"]
Jul 28 13:01:00.182806 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:01:00.182770    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd344ed25_a45d_4424_9cfe_6c05b320adaf.slice/crio-9cd7e3c1b4cc8a5e665414541b8668d6b5d2bdd6c7abcadcd82703da0ef17fd1 WatchSource:0}: Error finding container 9cd7e3c1b4cc8a5e665414541b8668d6b5d2bdd6c7abcadcd82703da0ef17fd1: Status 404 returned error can't find the container with id 9cd7e3c1b4cc8a5e665414541b8668d6b5d2bdd6c7abcadcd82703da0ef17fd1
Jul 28 13:01:00.220300 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.220263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cn5q\" (UniqueName: \"kubernetes.io/projected/fd0d8831-b6a8-476a-b741-307315022d2c-kube-api-access-9cn5q\") pod \"authorino-7f67f45676-z6rnl\" (UID: \"fd0d8831-b6a8-476a-b741-307315022d2c\") " pod="kuadrant-system/authorino-7f67f45676-z6rnl"
Jul 28 13:01:00.220502 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.220416    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd0d8831-b6a8-476a-b741-307315022d2c-tls-cert\") pod \"authorino-7f67f45676-z6rnl\" (UID: \"fd0d8831-b6a8-476a-b741-307315022d2c\") " pod="kuadrant-system/authorino-7f67f45676-z6rnl"
Jul 28 13:01:00.222755 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.222726    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f7ssb" event={"ID":"d344ed25-a45d-4424-9cfe-6c05b320adaf","Type":"ContainerStarted","Data":"9cd7e3c1b4cc8a5e665414541b8668d6b5d2bdd6c7abcadcd82703da0ef17fd1"}
Jul 28 13:01:00.223055 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.223039    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd0d8831-b6a8-476a-b741-307315022d2c-tls-cert\") pod \"authorino-7f67f45676-z6rnl\" (UID: \"fd0d8831-b6a8-476a-b741-307315022d2c\") " pod="kuadrant-system/authorino-7f67f45676-z6rnl"
Jul 28 13:01:00.230215 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.230186    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cn5q\" (UniqueName: \"kubernetes.io/projected/fd0d8831-b6a8-476a-b741-307315022d2c-kube-api-access-9cn5q\") pod \"authorino-7f67f45676-z6rnl\" (UID: \"fd0d8831-b6a8-476a-b741-307315022d2c\") " pod="kuadrant-system/authorino-7f67f45676-z6rnl"
Jul 28 13:01:00.407112 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.407029    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f67f45676-z6rnl"
Jul 28 13:01:00.545045 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:00.545017    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f67f45676-z6rnl"]
Jul 28 13:01:00.546974 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:01:00.546940    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd0d8831_b6a8_476a_b741_307315022d2c.slice/crio-851de299354c8d38ef844771bf9b5548c4441a040e9d2d208082e76abbef70a2 WatchSource:0}: Error finding container 851de299354c8d38ef844771bf9b5548c4441a040e9d2d208082e76abbef70a2: Status 404 returned error can't find the container with id 851de299354c8d38ef844771bf9b5548c4441a040e9d2d208082e76abbef70a2
Jul 28 13:01:01.230094 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:01.230059    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f7ssb" event={"ID":"d344ed25-a45d-4424-9cfe-6c05b320adaf","Type":"ContainerStarted","Data":"89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72"}
Jul 28 13:01:01.230094 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:01.230082    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-f7ssb" podUID="d344ed25-a45d-4424-9cfe-6c05b320adaf" containerName="authorino" containerID="cri-o://89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72" gracePeriod=30
Jul 28 13:01:01.231416 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:01.231391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f67f45676-z6rnl" event={"ID":"fd0d8831-b6a8-476a-b741-307315022d2c","Type":"ContainerStarted","Data":"851de299354c8d38ef844771bf9b5548c4441a040e9d2d208082e76abbef70a2"}
Jul 28 13:01:01.248151 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:01.248099    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-f7ssb" podStartSLOduration=1.762838029 podStartE2EDuration="2.248083371s" totalImagesPullingTime="485.245342ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:00:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:01:01.245974376 +0000 UTC m=+588.175258294" watchObservedRunningTime="2026-07-28 13:01:01.248083371 +0000 UTC m=+588.177367288"
Jul 28 13:01:01.481565 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:01.481485    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f7ssb"
Jul 28 13:01:01.531981 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:01.531908    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9phqv\" (UniqueName: \"kubernetes.io/projected/d344ed25-a45d-4424-9cfe-6c05b320adaf-kube-api-access-9phqv\") pod \"d344ed25-a45d-4424-9cfe-6c05b320adaf\" (UID: \"d344ed25-a45d-4424-9cfe-6c05b320adaf\") "
Jul 28 13:01:01.534037 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:01.534001    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d344ed25-a45d-4424-9cfe-6c05b320adaf-kube-api-access-9phqv" (OuterVolumeSpecName: "kube-api-access-9phqv") pod "d344ed25-a45d-4424-9cfe-6c05b320adaf" (UID: "d344ed25-a45d-4424-9cfe-6c05b320adaf"). InnerVolumeSpecName "kube-api-access-9phqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:01:01.633424 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:01.633381    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9phqv\" (UniqueName: \"kubernetes.io/projected/d344ed25-a45d-4424-9cfe-6c05b320adaf-kube-api-access-9phqv\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:01:02.238993 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:02.238959    2567 generic.go:356] "Generic (PLEG): container finished" podID="d344ed25-a45d-4424-9cfe-6c05b320adaf" containerID="89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72" exitCode=0
Jul 28 13:01:02.239212 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:02.239018    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f7ssb"
Jul 28 13:01:02.239212 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:02.239040    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f7ssb" event={"ID":"d344ed25-a45d-4424-9cfe-6c05b320adaf","Type":"ContainerDied","Data":"89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72"}
Jul 28 13:01:02.239212 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:02.239093    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f7ssb" event={"ID":"d344ed25-a45d-4424-9cfe-6c05b320adaf","Type":"ContainerDied","Data":"9cd7e3c1b4cc8a5e665414541b8668d6b5d2bdd6c7abcadcd82703da0ef17fd1"}
Jul 28 13:01:02.239212 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:02.239118    2567 scope.go:117] "RemoveContainer" containerID="89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72"
Jul 28 13:01:02.248507 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:02.248486    2567 scope.go:117] "RemoveContainer" containerID="89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72"
Jul 28 13:01:02.248883 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:01:02.248863    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72\": container with ID starting with 89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72 not found: ID does not exist" containerID="89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72"
Jul 28 13:01:02.248957 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:02.248894    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72"} err="failed to get container status \"89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72\": rpc error: code = NotFound desc = could not find container \"89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72\": container with ID starting with 89f7a4ab9ba1e155dd0438fe847160ae8d550c63d845ee46d2d63aabe092bf72 not found: ID does not exist"
Jul 28 13:01:02.261819 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:02.261784    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f7ssb"]
Jul 28 13:01:02.263824 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:02.263801    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f7ssb"]
Jul 28 13:01:03.501804 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:03.501768    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d344ed25-a45d-4424-9cfe-6c05b320adaf" path="/var/lib/kubelet/pods/d344ed25-a45d-4424-9cfe-6c05b320adaf/volumes"
Jul 28 13:01:05.257118 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:05.257082    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f67f45676-z6rnl" event={"ID":"fd0d8831-b6a8-476a-b741-307315022d2c","Type":"ContainerStarted","Data":"6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5"}
Jul 28 13:01:05.274230 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:05.274180    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f67f45676-z6rnl" podStartSLOduration=1.505353646 podStartE2EDuration="5.274162602s" totalImagesPullingTime="3.768808956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:01:05.272752863 +0000 UTC m=+592.202036780" watchObservedRunningTime="2026-07-28 13:01:05.274162602 +0000 UTC m=+592.203446497"
Jul 28 13:01:05.301538 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:05.301499    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8c5n6"]
Jul 28 13:01:05.301707 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:05.301686    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8c5n6" podUID="fc880b72-7a5b-473a-9ee6-9482c6622565" containerName="authorino" containerID="cri-o://77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429" gracePeriod=30
Jul 28 13:01:05.563331 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:05.563307    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8c5n6"
Jul 28 13:01:05.677297 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:05.677262    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9lx4\" (UniqueName: \"kubernetes.io/projected/fc880b72-7a5b-473a-9ee6-9482c6622565-kube-api-access-x9lx4\") pod \"fc880b72-7a5b-473a-9ee6-9482c6622565\" (UID: \"fc880b72-7a5b-473a-9ee6-9482c6622565\") "
Jul 28 13:01:05.679338 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:05.679310    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc880b72-7a5b-473a-9ee6-9482c6622565-kube-api-access-x9lx4" (OuterVolumeSpecName: "kube-api-access-x9lx4") pod "fc880b72-7a5b-473a-9ee6-9482c6622565" (UID: "fc880b72-7a5b-473a-9ee6-9482c6622565"). InnerVolumeSpecName "kube-api-access-x9lx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:01:05.778346 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:05.778303    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9lx4\" (UniqueName: \"kubernetes.io/projected/fc880b72-7a5b-473a-9ee6-9482c6622565-kube-api-access-x9lx4\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:01:06.264157 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:06.264120    2567 generic.go:356] "Generic (PLEG): container finished" podID="fc880b72-7a5b-473a-9ee6-9482c6622565" containerID="77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429" exitCode=0
Jul 28 13:01:06.264157 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:06.264162    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8c5n6"
Jul 28 13:01:06.264782 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:06.264205    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8c5n6" event={"ID":"fc880b72-7a5b-473a-9ee6-9482c6622565","Type":"ContainerDied","Data":"77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429"}
Jul 28 13:01:06.264782 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:06.264238    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8c5n6" event={"ID":"fc880b72-7a5b-473a-9ee6-9482c6622565","Type":"ContainerDied","Data":"15654b4077b0ff29654d491c01f4e739b15e8aff6d75eb85c9698762522a3feb"}
Jul 28 13:01:06.264782 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:06.264261    2567 scope.go:117] "RemoveContainer" containerID="77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429"
Jul 28 13:01:06.272876 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:06.272858    2567 scope.go:117] "RemoveContainer" containerID="77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429"
Jul 28 13:01:06.273206 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:01:06.273188    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429\": container with ID starting with 77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429 not found: ID does not exist" containerID="77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429"
Jul 28 13:01:06.273280 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:06.273216    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429"} err="failed to get container status \"77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429\": rpc error: code = NotFound desc = could not find container \"77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429\": container with ID starting with 77cee622095e690013a115b845d2c0ef7d8914a42d61650d076f7ec695e24429 not found: ID does not exist"
Jul 28 13:01:06.288286 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:06.288257    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8c5n6"]
Jul 28 13:01:06.293243 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:06.293221    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8c5n6"]
Jul 28 13:01:07.500736 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:07.500703    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc880b72-7a5b-473a-9ee6-9482c6622565" path="/var/lib/kubelet/pods/fc880b72-7a5b-473a-9ee6-9482c6622565/volumes"
Jul 28 13:01:10.271770 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:10.271729    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:10.377283 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:10.377248    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:10.444140 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:10.444103    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:10.564744 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:10.564642    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:13.743059 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:13.742952    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:13.839619 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:13.839584    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:16.959445 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:16.959411    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:27.145016 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:27.144979    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:45.382418 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:45.382325    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:46.674937 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.674895    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"]
Jul 28 13:01:46.675331 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.675238    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc880b72-7a5b-473a-9ee6-9482c6622565" containerName="authorino"
Jul 28 13:01:46.675331 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.675249    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc880b72-7a5b-473a-9ee6-9482c6622565" containerName="authorino"
Jul 28 13:01:46.675331 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.675260    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d344ed25-a45d-4424-9cfe-6c05b320adaf" containerName="authorino"
Jul 28 13:01:46.675331 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.675265    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d344ed25-a45d-4424-9cfe-6c05b320adaf" containerName="authorino"
Jul 28 13:01:46.675331 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.675326    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d344ed25-a45d-4424-9cfe-6c05b320adaf" containerName="authorino"
Jul 28 13:01:46.675493 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.675336    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc880b72-7a5b-473a-9ee6-9482c6622565" containerName="authorino"
Jul 28 13:01:46.678346 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.678326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"
Jul 28 13:01:46.680799 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.680777    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 13:01:46.690476 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.690451    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"]
Jul 28 13:01:46.753304 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.753263    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l227t\" (UniqueName: \"kubernetes.io/projected/97b468fc-bad3-458f-accb-86c8cfdcb950-kube-api-access-l227t\") pod \"payload-pre-processing-687dbb6cf6-rqvtg\" (UID: \"97b468fc-bad3-458f-accb-86c8cfdcb950\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"
Jul 28 13:01:46.753501 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.753388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97b468fc-bad3-458f-accb-86c8cfdcb950-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-rqvtg\" (UID: \"97b468fc-bad3-458f-accb-86c8cfdcb950\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"
Jul 28 13:01:46.854396 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.854342    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97b468fc-bad3-458f-accb-86c8cfdcb950-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-rqvtg\" (UID: \"97b468fc-bad3-458f-accb-86c8cfdcb950\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"
Jul 28 13:01:46.854601 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.854427    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l227t\" (UniqueName: \"kubernetes.io/projected/97b468fc-bad3-458f-accb-86c8cfdcb950-kube-api-access-l227t\") pod \"payload-pre-processing-687dbb6cf6-rqvtg\" (UID: \"97b468fc-bad3-458f-accb-86c8cfdcb950\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"
Jul 28 13:01:46.855310 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.855282    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97b468fc-bad3-458f-accb-86c8cfdcb950-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-rqvtg\" (UID: \"97b468fc-bad3-458f-accb-86c8cfdcb950\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"
Jul 28 13:01:46.868246 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.868217    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l227t\" (UniqueName: \"kubernetes.io/projected/97b468fc-bad3-458f-accb-86c8cfdcb950-kube-api-access-l227t\") pod \"payload-pre-processing-687dbb6cf6-rqvtg\" (UID: \"97b468fc-bad3-458f-accb-86c8cfdcb950\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"
Jul 28 13:01:46.989012 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:46.988891    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"
Jul 28 13:01:47.132189 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:47.132161    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"]
Jul 28 13:01:47.134115 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:01:47.134081    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b468fc_bad3_458f_accb_86c8cfdcb950.slice/crio-c665ae9f8f85722c2c9d5e5bfeb0193c54446d922e17e8a52c34cfa0c18289b6 WatchSource:0}: Error finding container c665ae9f8f85722c2c9d5e5bfeb0193c54446d922e17e8a52c34cfa0c18289b6: Status 404 returned error can't find the container with id c665ae9f8f85722c2c9d5e5bfeb0193c54446d922e17e8a52c34cfa0c18289b6
Jul 28 13:01:47.135775 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:47.135758    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:01:47.471452 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:47.471416    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg" event={"ID":"97b468fc-bad3-458f-accb-86c8cfdcb950","Type":"ContainerStarted","Data":"c665ae9f8f85722c2c9d5e5bfeb0193c54446d922e17e8a52c34cfa0c18289b6"}
Jul 28 13:01:47.595802 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:47.595763    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:49.485040 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:49.484940    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg" event={"ID":"97b468fc-bad3-458f-accb-86c8cfdcb950","Type":"ContainerStarted","Data":"b8128881b7c235ce37a0d4478179bcc79b5623dc5509719bfb1b8d801aedde4d"}
Jul 28 13:01:49.485040 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:49.485009    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"
Jul 28 13:01:49.504689 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:49.504636    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg" podStartSLOduration=1.492818632 podStartE2EDuration="3.50461747s" totalImagesPullingTime="2.011798838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:01:49.503647797 +0000 UTC m=+636.432931715" watchObservedRunningTime="2026-07-28 13:01:49.50461747 +0000 UTC m=+636.433901386"
Jul 28 13:01:53.926718 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:53.926676    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:53.989828 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:53.989790    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:54.510666 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:54.510576    2567 generic.go:356] "Generic (PLEG): container finished" podID="da01587a-958c-4fa8-858c-8baae2332d54" containerID="5cc3129ad44d8630104ed3a1dd786ed7d563919334ef1f206f60480b9cb69f21" exitCode=0
Jul 28 13:01:54.510666 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:54.510652    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" event={"ID":"da01587a-958c-4fa8-858c-8baae2332d54","Type":"ContainerDied","Data":"5cc3129ad44d8630104ed3a1dd786ed7d563919334ef1f206f60480b9cb69f21"}
Jul 28 13:01:54.511048 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:54.511032    2567 scope.go:117] "RemoveContainer" containerID="5cc3129ad44d8630104ed3a1dd786ed7d563919334ef1f206f60480b9cb69f21"
Jul 28 13:01:54.512060 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:54.512034    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:01:54.512135 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:54.512118    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:01:54.512177 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:54.512159    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:01:55.018238 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:55.018188    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:01:55.518629 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:55.518594    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" event={"ID":"da01587a-958c-4fa8-858c-8baae2332d54","Type":"ContainerStarted","Data":"845832fdecec8bad1eaf659a7ece7c976edb37037f5044fc1436901455621c07"}
Jul 28 13:01:55.918745 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:55.918656    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:01:55.919610 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:55.919588    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zk8s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 13:01:55.919668 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:55.919639    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" podUID="da01587a-958c-4fa8-858c-8baae2332d54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 13:01:56.919324 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:56.919291    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zk8s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 13:01:56.919721 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:56.919373    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" podUID="da01587a-958c-4fa8-858c-8baae2332d54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 13:01:56.975650 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:56.975616    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:57.109539 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:57.109498    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:01:57.918963 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:57.918904    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zk8s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 13:01:57.919178 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:57.918998    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" podUID="da01587a-958c-4fa8-858c-8baae2332d54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 13:01:58.919480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:58.919441    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zk8s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 13:01:58.919904 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:58.919497    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" podUID="da01587a-958c-4fa8-858c-8baae2332d54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 13:01:59.919278 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:59.919242    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zk8s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 13:01:59.919465 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:01:59.919301    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" podUID="da01587a-958c-4fa8-858c-8baae2332d54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 13:02:00.492374 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:00.492344    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-rqvtg"
Jul 28 13:02:00.919540 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:00.919497    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zk8s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 13:02:00.919717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:00.919556    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8" podUID="da01587a-958c-4fa8-858c-8baae2332d54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 13:02:01.923008 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:01.922977    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:02:01.923476 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:01.923273    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:02:01.924009 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:01.923988    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zk8s8"
Jul 28 13:02:14.814944 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:14.814887    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:31.592047 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:31.592000    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:34.593629 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.593597    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"]
Jul 28 13:02:34.597345 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.597325    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.601112 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.601076    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 28 13:02:34.601253 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.601139    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 13:02:34.601253 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.601116    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 13:02:34.601387 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.601122    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-llgkj\""
Jul 28 13:02:34.602701 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.602678    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"]
Jul 28 13:02:34.684549 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.684510    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.684549 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.684551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.684756 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.684602    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.684756 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.684632    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.684756 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.684687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6cpb\" (UniqueName: \"kubernetes.io/projected/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-kube-api-access-t6cpb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.684756 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.684711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.695306 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.695275    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:34.785250 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.785218    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.785250 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.785251    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.785513 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.785278    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.785513 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.785294    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.785513 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.785329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6cpb\" (UniqueName: \"kubernetes.io/projected/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-kube-api-access-t6cpb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.785513 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.785356    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.785728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.785691    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.785797 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.785768    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.785885 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.785861    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.787618 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.787593    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.787863 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.787848    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.793459 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.793436    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6cpb\" (UniqueName: \"kubernetes.io/projected/e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de-kube-api-access-t6cpb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cbchg\" (UID: \"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:34.909961 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:34.909844    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:35.048170 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:35.048139    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"]
Jul 28 13:02:35.049537 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:02:35.049508    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b7f31e_92b9_4b2e_99c9_9b6bfb7d80de.slice/crio-e598d4347a8052b2c78991e33577e821148ec69c2124466278b2acd71aabfbab WatchSource:0}: Error finding container e598d4347a8052b2c78991e33577e821148ec69c2124466278b2acd71aabfbab: Status 404 returned error can't find the container with id e598d4347a8052b2c78991e33577e821148ec69c2124466278b2acd71aabfbab
Jul 28 13:02:35.743562 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:35.743517    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg" event={"ID":"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de","Type":"ContainerStarted","Data":"e598d4347a8052b2c78991e33577e821148ec69c2124466278b2acd71aabfbab"}
Jul 28 13:02:36.750393 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:36.750357    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg" event={"ID":"e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de","Type":"ContainerStarted","Data":"facfebe39dcc87db1ea1e4e28b1b26518041edc76d5f8addb6a652fddefdb1d1"}
Jul 28 13:02:36.772302 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:36.772251    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg" podStartSLOduration=1.6567974859999999 podStartE2EDuration="2.772232946s" totalImagesPullingTime="1.11543546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:02:36.770370525 +0000 UTC m=+683.699654454" watchObservedRunningTime="2026-07-28 13:02:36.772232946 +0000 UTC m=+683.701516863"
Jul 28 13:02:43.128810 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:43.128774    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:44.723911 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:44.723877    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:44.910438 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:44.910400    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:44.910608 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:44.910464    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:44.923475 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:44.923446    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:45.806672 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:45.806640    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cbchg"
Jul 28 13:02:48.691860 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.691808    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"]
Jul 28 13:02:48.695350 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.695333    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.697939 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.697897    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 28 13:02:48.706372 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.706350    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"]
Jul 28 13:02:48.777140 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.777105    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:48.796287 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.796249    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c56v9\" (UniqueName: \"kubernetes.io/projected/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-kube-api-access-c56v9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.796454 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.796313    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.796454 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.796358    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.796454 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.796379    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.796454 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.796394    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.796454 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.796415    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.897423 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.897382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.897423 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.897438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.897717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.897460    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.897717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.897478    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.897717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.897512    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.897717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.897570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c56v9\" (UniqueName: \"kubernetes.io/projected/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-kube-api-access-c56v9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.898007 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.897972    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.898123 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.898041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.898123 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.898041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.899868 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.899840    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.900031 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.900013    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:48.906752 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:48.906730    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c56v9\" (UniqueName: \"kubernetes.io/projected/f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86-kube-api-access-c56v9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc\" (UID: \"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:49.006066 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:49.005959    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:49.151264 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:49.151234    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"]
Jul 28 13:02:49.152773 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:02:49.152747    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf511f145_3a11_4b5f_8a0f_1cdbc7ab2f86.slice/crio-a64ed0e248f36e1ba74db615ebb48dc976893b036e969f80f14b063a4ae01997 WatchSource:0}: Error finding container a64ed0e248f36e1ba74db615ebb48dc976893b036e969f80f14b063a4ae01997: Status 404 returned error can't find the container with id a64ed0e248f36e1ba74db615ebb48dc976893b036e969f80f14b063a4ae01997
Jul 28 13:02:49.820893 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:49.820860    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc" event={"ID":"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86","Type":"ContainerStarted","Data":"6106df7f33e23dfdfde182c35dba8c82f391fd896be9991d69c95beec8ff1045"}
Jul 28 13:02:49.821299 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:49.820912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc" event={"ID":"f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86","Type":"ContainerStarted","Data":"a64ed0e248f36e1ba74db615ebb48dc976893b036e969f80f14b063a4ae01997"}
Jul 28 13:02:49.840645 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:49.840588    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc" podStartSLOduration=1.599389563 podStartE2EDuration="1.840567972s" totalImagesPullingTime="241.178409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:02:49.838813729 +0000 UTC m=+696.768097646" watchObservedRunningTime="2026-07-28 13:02:49.840567972 +0000 UTC m=+696.769851944"
Jul 28 13:02:59.006121 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:59.006078    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:59.006532 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:59.006162    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:59.019098 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:59.019071    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:02:59.628398 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:59.628365    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:02:59.889595 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:02:59.889513    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc"
Jul 28 13:03:11.425623 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:11.425542    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:51.115042 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.115004    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59bd69798f-j97ll"]
Jul 28 13:03:51.118665 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.118642    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59bd69798f-j97ll"
Jul 28 13:03:51.128202 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.128177    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59bd69798f-j97ll"]
Jul 28 13:03:51.148778 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.148747    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee3712b4-2b15-4adc-8d0d-10bfbe516014-tls-cert\") pod \"authorino-59bd69798f-j97ll\" (UID: \"ee3712b4-2b15-4adc-8d0d-10bfbe516014\") " pod="kuadrant-system/authorino-59bd69798f-j97ll"
Jul 28 13:03:51.148958 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.148793    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jznhq\" (UniqueName: \"kubernetes.io/projected/ee3712b4-2b15-4adc-8d0d-10bfbe516014-kube-api-access-jznhq\") pod \"authorino-59bd69798f-j97ll\" (UID: \"ee3712b4-2b15-4adc-8d0d-10bfbe516014\") " pod="kuadrant-system/authorino-59bd69798f-j97ll"
Jul 28 13:03:51.250289 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.250250    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee3712b4-2b15-4adc-8d0d-10bfbe516014-tls-cert\") pod \"authorino-59bd69798f-j97ll\" (UID: \"ee3712b4-2b15-4adc-8d0d-10bfbe516014\") " pod="kuadrant-system/authorino-59bd69798f-j97ll"
Jul 28 13:03:51.250487 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.250316    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jznhq\" (UniqueName: \"kubernetes.io/projected/ee3712b4-2b15-4adc-8d0d-10bfbe516014-kube-api-access-jznhq\") pod \"authorino-59bd69798f-j97ll\" (UID: \"ee3712b4-2b15-4adc-8d0d-10bfbe516014\") " pod="kuadrant-system/authorino-59bd69798f-j97ll"
Jul 28 13:03:51.252801 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.252773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee3712b4-2b15-4adc-8d0d-10bfbe516014-tls-cert\") pod \"authorino-59bd69798f-j97ll\" (UID: \"ee3712b4-2b15-4adc-8d0d-10bfbe516014\") " pod="kuadrant-system/authorino-59bd69798f-j97ll"
Jul 28 13:03:51.258455 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.258421    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jznhq\" (UniqueName: \"kubernetes.io/projected/ee3712b4-2b15-4adc-8d0d-10bfbe516014-kube-api-access-jznhq\") pod \"authorino-59bd69798f-j97ll\" (UID: \"ee3712b4-2b15-4adc-8d0d-10bfbe516014\") " pod="kuadrant-system/authorino-59bd69798f-j97ll"
Jul 28 13:03:51.429085 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.428983    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59bd69798f-j97ll"
Jul 28 13:03:51.566364 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:51.566331    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59bd69798f-j97ll"]
Jul 28 13:03:51.569024 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:03:51.568995    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee3712b4_2b15_4adc_8d0d_10bfbe516014.slice/crio-2c5547fb3e755a70a45fe65d2ae5b714fc90e914a6abc4d243b4611494273de6 WatchSource:0}: Error finding container 2c5547fb3e755a70a45fe65d2ae5b714fc90e914a6abc4d243b4611494273de6: Status 404 returned error can't find the container with id 2c5547fb3e755a70a45fe65d2ae5b714fc90e914a6abc4d243b4611494273de6
Jul 28 13:03:52.166072 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.166003    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59bd69798f-j97ll" event={"ID":"ee3712b4-2b15-4adc-8d0d-10bfbe516014","Type":"ContainerStarted","Data":"c25593ca0f54bc687d351110be09c87918e6c537bc5ac5f948016f8196b47294"}
Jul 28 13:03:52.166072 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.166058    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59bd69798f-j97ll" event={"ID":"ee3712b4-2b15-4adc-8d0d-10bfbe516014","Type":"ContainerStarted","Data":"2c5547fb3e755a70a45fe65d2ae5b714fc90e914a6abc4d243b4611494273de6"}
Jul 28 13:03:52.182903 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.182852    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59bd69798f-j97ll" podStartSLOduration=0.746319996 podStartE2EDuration="1.182832264s" totalImagesPullingTime="436.512268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:03:52.182466331 +0000 UTC m=+759.111750247" watchObservedRunningTime="2026-07-28 13:03:52.182832264 +0000 UTC m=+759.112116184"
Jul 28 13:03:52.213442 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.213403    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f67f45676-z6rnl"]
Jul 28 13:03:52.213627 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.213585    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7f67f45676-z6rnl" podUID="fd0d8831-b6a8-476a-b741-307315022d2c" containerName="authorino" containerID="cri-o://6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5" gracePeriod=30
Jul 28 13:03:52.488633 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.488605    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f67f45676-z6rnl"
Jul 28 13:03:52.562202 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.562104    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd0d8831-b6a8-476a-b741-307315022d2c-tls-cert\") pod \"fd0d8831-b6a8-476a-b741-307315022d2c\" (UID: \"fd0d8831-b6a8-476a-b741-307315022d2c\") "
Jul 28 13:03:52.562376 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.562244    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cn5q\" (UniqueName: \"kubernetes.io/projected/fd0d8831-b6a8-476a-b741-307315022d2c-kube-api-access-9cn5q\") pod \"fd0d8831-b6a8-476a-b741-307315022d2c\" (UID: \"fd0d8831-b6a8-476a-b741-307315022d2c\") "
Jul 28 13:03:52.564207 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.564174    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd0d8831-b6a8-476a-b741-307315022d2c-kube-api-access-9cn5q" (OuterVolumeSpecName: "kube-api-access-9cn5q") pod "fd0d8831-b6a8-476a-b741-307315022d2c" (UID: "fd0d8831-b6a8-476a-b741-307315022d2c"). InnerVolumeSpecName "kube-api-access-9cn5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:03:52.573777 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.573742    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd0d8831-b6a8-476a-b741-307315022d2c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fd0d8831-b6a8-476a-b741-307315022d2c" (UID: "fd0d8831-b6a8-476a-b741-307315022d2c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:03:52.663135 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.663094    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cn5q\" (UniqueName: \"kubernetes.io/projected/fd0d8831-b6a8-476a-b741-307315022d2c-kube-api-access-9cn5q\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:03:52.663135 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.663124    2567 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fd0d8831-b6a8-476a-b741-307315022d2c-tls-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:03:52.749146 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:52.749100    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:53.173414 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.173383    2567 generic.go:356] "Generic (PLEG): container finished" podID="fd0d8831-b6a8-476a-b741-307315022d2c" containerID="6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5" exitCode=0
Jul 28 13:03:53.173899 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.173423    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f67f45676-z6rnl"
Jul 28 13:03:53.173899 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.173474    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f67f45676-z6rnl" event={"ID":"fd0d8831-b6a8-476a-b741-307315022d2c","Type":"ContainerDied","Data":"6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5"}
Jul 28 13:03:53.173899 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.173524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f67f45676-z6rnl" event={"ID":"fd0d8831-b6a8-476a-b741-307315022d2c","Type":"ContainerDied","Data":"851de299354c8d38ef844771bf9b5548c4441a040e9d2d208082e76abbef70a2"}
Jul 28 13:03:53.173899 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.173550    2567 scope.go:117] "RemoveContainer" containerID="6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5"
Jul 28 13:03:53.183793 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.183771    2567 scope.go:117] "RemoveContainer" containerID="6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5"
Jul 28 13:03:53.184131 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:03:53.184111    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5\": container with ID starting with 6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5 not found: ID does not exist" containerID="6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5"
Jul 28 13:03:53.184252 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.184145    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5"} err="failed to get container status \"6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5\": rpc error: code = NotFound desc = could not find container \"6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5\": container with ID starting with 6ed5efbd1cf877361893446db0dd5659199ffe8c3009314b37c17780b3af18f5 not found: ID does not exist"
Jul 28 13:03:53.199249 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.199212    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f67f45676-z6rnl"]
Jul 28 13:03:53.213793 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.213761    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f67f45676-z6rnl"]
Jul 28 13:03:53.348209 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.348172    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:53.502895 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.502818    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd0d8831-b6a8-476a-b741-307315022d2c" path="/var/lib/kubelet/pods/fd0d8831-b6a8-476a-b741-307315022d2c/volumes"
Jul 28 13:03:53.896374 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.896330    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:03:53.994537 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:03:53.994501    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:01.870263 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:05:01.870222    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:01.935957 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:05:01.935905    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:05:59.029472 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:05:59.029434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:00.524057 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:06:00.524022    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:36.097560 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:06:36.097520    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:36.192253 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:06:36.192219    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:36.360789 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:06:36.360686    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:42.351831 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:06:42.351799    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:42.463168 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:06:42.463139    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:42.554675 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:06:42.554627    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:42.969085 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:06:42.969051    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:48.601325 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:06:48.601290    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:06:49.860050 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:06:49.860012    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:07:00.692680 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:07:00.692633    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:08:06.396989 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:08:06.396951    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:07.761029 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:10:07.760993    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:07.893634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:10:07.893603    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:10:07.972464 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:10:07.972426    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:11:08.226843 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:08.226758    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"]
Jul 28 13:11:08.227427 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:08.226987    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7" podUID="73fa203e-6d6d-42f1-9a6d-ebbc5924d9de" containerName="manager" containerID="cri-o://a851fbbcd122a550143608654532c91649134a24ee6b635ee5be8e7712cf9036" gracePeriod=10
Jul 28 13:11:09.556355 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:09.556324    2567 generic.go:356] "Generic (PLEG): container finished" podID="73fa203e-6d6d-42f1-9a6d-ebbc5924d9de" containerID="a851fbbcd122a550143608654532c91649134a24ee6b635ee5be8e7712cf9036" exitCode=0
Jul 28 13:11:09.556719 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:09.556396    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7" event={"ID":"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de","Type":"ContainerDied","Data":"a851fbbcd122a550143608654532c91649134a24ee6b635ee5be8e7712cf9036"}
Jul 28 13:11:10.181588 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.181566    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 13:11:10.271207 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.271176    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n2hj\" (UniqueName: \"kubernetes.io/projected/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-kube-api-access-6n2hj\") pod \"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de\" (UID: \"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de\") "
Jul 28 13:11:10.271380 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.271273    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-extensions-socket-volume\") pod \"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de\" (UID: \"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de\") "
Jul 28 13:11:10.271680 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.271656    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "73fa203e-6d6d-42f1-9a6d-ebbc5924d9de" (UID: "73fa203e-6d6d-42f1-9a6d-ebbc5924d9de"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:11:10.273432 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.273408    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-kube-api-access-6n2hj" (OuterVolumeSpecName: "kube-api-access-6n2hj") pod "73fa203e-6d6d-42f1-9a6d-ebbc5924d9de" (UID: "73fa203e-6d6d-42f1-9a6d-ebbc5924d9de"). InnerVolumeSpecName "kube-api-access-6n2hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:11:10.372316 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.372221    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n2hj\" (UniqueName: \"kubernetes.io/projected/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-kube-api-access-6n2hj\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:11:10.372316 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.372251    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de-extensions-socket-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:11:10.562934 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.562898    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"
Jul 28 13:11:10.563357 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.562958    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7" event={"ID":"73fa203e-6d6d-42f1-9a6d-ebbc5924d9de","Type":"ContainerDied","Data":"8e3111c55ca978d6f0e8d02cd28c4d35576dfee96fa0a592fd60c9c577d69b35"}
Jul 28 13:11:10.563357 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.563024    2567 scope.go:117] "RemoveContainer" containerID="a851fbbcd122a550143608654532c91649134a24ee6b635ee5be8e7712cf9036"
Jul 28 13:11:10.588654 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.588626    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"]
Jul 28 13:11:10.594320 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:10.594291    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-cwmr7"]
Jul 28 13:11:11.500995 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:11:11.500963    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73fa203e-6d6d-42f1-9a6d-ebbc5924d9de" path="/var/lib/kubelet/pods/73fa203e-6d6d-42f1-9a6d-ebbc5924d9de/volumes"
Jul 28 13:12:09.442205 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.442116    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"]
Jul 28 13:12:09.444579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.442484    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73fa203e-6d6d-42f1-9a6d-ebbc5924d9de" containerName="manager"
Jul 28 13:12:09.444579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.442495    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="73fa203e-6d6d-42f1-9a6d-ebbc5924d9de" containerName="manager"
Jul 28 13:12:09.444579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.442508    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd0d8831-b6a8-476a-b741-307315022d2c" containerName="authorino"
Jul 28 13:12:09.444579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.442514    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd0d8831-b6a8-476a-b741-307315022d2c" containerName="authorino"
Jul 28 13:12:09.444579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.442576    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd0d8831-b6a8-476a-b741-307315022d2c" containerName="authorino"
Jul 28 13:12:09.444579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.442584    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="73fa203e-6d6d-42f1-9a6d-ebbc5924d9de" containerName="manager"
Jul 28 13:12:09.445573 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.445556    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"
Jul 28 13:12:09.448134 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.448109    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-76vmt\""
Jul 28 13:12:09.459150 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.459125    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"]
Jul 28 13:12:09.500364 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.500327    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5tsc\" (UniqueName: \"kubernetes.io/projected/2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d-kube-api-access-n5tsc\") pod \"kuadrant-operator-controller-manager-86878c769f-tc5zp\" (UID: \"2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"
Jul 28 13:12:09.500571 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.500379    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tc5zp\" (UID: \"2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"
Jul 28 13:12:09.601452 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.601408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5tsc\" (UniqueName: \"kubernetes.io/projected/2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d-kube-api-access-n5tsc\") pod \"kuadrant-operator-controller-manager-86878c769f-tc5zp\" (UID: \"2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"
Jul 28 13:12:09.601617 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.601476    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tc5zp\" (UID: \"2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"
Jul 28 13:12:09.601987 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.601959    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tc5zp\" (UID: \"2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"
Jul 28 13:12:09.611083 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.611057    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5tsc\" (UniqueName: \"kubernetes.io/projected/2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d-kube-api-access-n5tsc\") pod \"kuadrant-operator-controller-manager-86878c769f-tc5zp\" (UID: \"2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"
Jul 28 13:12:09.756141 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.756046    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"
Jul 28 13:12:09.901098 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:09.901074    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"]
Jul 28 13:12:09.903012 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:12:09.902987    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd5b480_9d3a_4f0b_b54a_99fee89d5c9d.slice/crio-3b2b0e0e6eed880294ddf2263ea6155cfda140719f3bebfba50c47ce94e11615 WatchSource:0}: Error finding container 3b2b0e0e6eed880294ddf2263ea6155cfda140719f3bebfba50c47ce94e11615: Status 404 returned error can't find the container with id 3b2b0e0e6eed880294ddf2263ea6155cfda140719f3bebfba50c47ce94e11615
Jul 28 13:12:10.881802 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:10.881768    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp" event={"ID":"2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d","Type":"ContainerStarted","Data":"c1ed375b2d48de9fd32c54a90f362943c95efe7b0fe2130079fc53860b634b47"}
Jul 28 13:12:10.882225 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:10.881819    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp" event={"ID":"2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d","Type":"ContainerStarted","Data":"3b2b0e0e6eed880294ddf2263ea6155cfda140719f3bebfba50c47ce94e11615"}
Jul 28 13:12:10.882225 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:10.881878    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"
Jul 28 13:12:10.906438 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:10.906388    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp" podStartSLOduration=1.90637229 podStartE2EDuration="1.90637229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:12:10.903381741 +0000 UTC m=+1257.832665658" watchObservedRunningTime="2026-07-28 13:12:10.90637229 +0000 UTC m=+1257.835656206"
Jul 28 13:12:17.261522 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:17.261478    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:12:21.889473 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:12:21.889438    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tc5zp"
Jul 28 13:13:16.355201 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:13:16.355167    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:14:59.497743 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:14:59.497699    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:15:00.144036 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:00.144000    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754075-hvqw5"]
Jul 28 13:15:00.147838 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:00.147814    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754075-hvqw5"
Jul 28 13:15:00.150533 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:00.150513    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6qfh\""
Jul 28 13:15:00.156019 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:00.155981    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754075-hvqw5"]
Jul 28 13:15:00.159580 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:00.159560    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754075-hvqw5"
Jul 28 13:15:00.306624 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:00.306598    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754075-hvqw5"]
Jul 28 13:15:00.308313 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:15:00.308279    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7d4489_6133_4e4a_bfdc_b7033e441570.slice/crio-a5579a192c332f11ffdc7f110a979d03e10a3589459d3c005f0e7587c1eb2d05 WatchSource:0}: Error finding container a5579a192c332f11ffdc7f110a979d03e10a3589459d3c005f0e7587c1eb2d05: Status 404 returned error can't find the container with id a5579a192c332f11ffdc7f110a979d03e10a3589459d3c005f0e7587c1eb2d05
Jul 28 13:15:00.310078 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:00.310063    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:15:00.801431 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:00.801397    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754075-hvqw5" event={"ID":"3b7d4489-6133-4e4a-bfdc-b7033e441570","Type":"ContainerStarted","Data":"a5579a192c332f11ffdc7f110a979d03e10a3589459d3c005f0e7587c1eb2d05"}
Jul 28 13:15:03.820388 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:03.820355    2567 generic.go:356] "Generic (PLEG): container finished" podID="3b7d4489-6133-4e4a-bfdc-b7033e441570" containerID="532ca82d654ff0f923d9b1d017e65f5f9ef54fb9a21fd2e68bc2c6dda1d8513d" exitCode=0
Jul 28 13:15:03.820775 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:03.820428    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754075-hvqw5" event={"ID":"3b7d4489-6133-4e4a-bfdc-b7033e441570","Type":"ContainerDied","Data":"532ca82d654ff0f923d9b1d017e65f5f9ef54fb9a21fd2e68bc2c6dda1d8513d"}
Jul 28 13:15:04.975520 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:04.975495    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754075-hvqw5"
Jul 28 13:15:05.122869 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:05.122741    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:15:05.834002 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:05.833971    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754075-hvqw5"
Jul 28 13:15:05.834002 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:05.833984    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754075-hvqw5" event={"ID":"3b7d4489-6133-4e4a-bfdc-b7033e441570","Type":"ContainerDied","Data":"a5579a192c332f11ffdc7f110a979d03e10a3589459d3c005f0e7587c1eb2d05"}
Jul 28 13:15:05.834255 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:05.834045    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5579a192c332f11ffdc7f110a979d03e10a3589459d3c005f0e7587c1eb2d05"
Jul 28 13:15:27.865518 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:27.865484    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:15:28.625299 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:15:28.625267    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:16:49.323171 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:16:49.323084    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:17:34.703719 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:17:34.703685    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:18:32.807564 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:18:32.807530    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:18:41.559358 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:18:41.559326    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:05.560813 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:05.560776    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:14.074161 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:14.074123    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:14.170812 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:14.170781    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:14.561851 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:14.561822    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:20.446027 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:20.445990    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:20.545050 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:20.545015    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:20.716954 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:20.716831    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:20.985018 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:20.984934    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"]
Jul 28 13:19:20.985461 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:20.985446    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b7d4489-6133-4e4a-bfdc-b7033e441570" containerName="cleanup"
Jul 28 13:19:20.985504 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:20.985464    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b7d4489-6133-4e4a-bfdc-b7033e441570" containerName="cleanup"
Jul 28 13:19:20.985569 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:20.985559    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b7d4489-6133-4e4a-bfdc-b7033e441570" containerName="cleanup"
Jul 28 13:19:20.988952 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:20.988933    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:20.991668 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:20.991646    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0142f26b-openshift-default-dockercfg-d5r2q\""
Jul 28 13:19:21.009813 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.009782    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"]
Jul 28 13:19:21.016539 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.016512    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:21.025869 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.025838    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-token\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.025869 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.025875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istiod-ca-cert\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.026113 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.025984    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5zg5\" (UniqueName: \"kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-kube-api-access-j5zg5\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.026113 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.026014    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-socket\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.026113 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.026048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-podinfo\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.026113 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.026092    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-envoy\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.026308 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.026112    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-certs\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.026308 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.026139    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-credential-socket\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.026308 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.026170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-data\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.127399 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.127357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5zg5\" (UniqueName: \"kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-kube-api-access-j5zg5\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.127399 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.127399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-socket\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.127684 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.127425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-podinfo\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.127684 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.127472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-envoy\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.127684 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.127497    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-certs\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.127684 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.127533    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-credential-socket\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.127684 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.127555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-data\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.127684 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.127636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-token\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.127684 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.127662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istiod-ca-cert\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.128179 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.128154    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-socket\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.131935 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.128835    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istiod-ca-cert\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.131935 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.129063    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-certs\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.131935 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.129599    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-credential-socket\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.131935 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.129818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-data\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.131935 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.130739    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-envoy\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.131935 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.131086    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-podinfo\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.137678 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.137650    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5zg5\" (UniqueName: \"kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-kube-api-access-j5zg5\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.137964 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.137907    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-token\") pod \"e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") " pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.302390 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.302350    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:21.459084 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.459053    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"]
Jul 28 13:19:21.461019 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:19:21.460990    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42a0dd0_1c3d_4cc6_ae56_845c4ae38e96.slice/crio-74e088d0e5a7ed5249c72f5d07b8d7c425813f1be7a9bf1c0eab653e88773a60 WatchSource:0}: Error finding container 74e088d0e5a7ed5249c72f5d07b8d7c425813f1be7a9bf1c0eab653e88773a60: Status 404 returned error can't find the container with id 74e088d0e5a7ed5249c72f5d07b8d7c425813f1be7a9bf1c0eab653e88773a60
Jul 28 13:19:21.463654 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.463623    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:19:21.463730 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.463693    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:19:21.463769 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.463732    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:19:21.676487 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:21.676376    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:22.243105 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:22.243068    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" event={"ID":"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96","Type":"ContainerStarted","Data":"db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d"}
Jul 28 13:19:22.243283 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:22.243119    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" event={"ID":"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96","Type":"ContainerStarted","Data":"74e088d0e5a7ed5249c72f5d07b8d7c425813f1be7a9bf1c0eab653e88773a60"}
Jul 28 13:19:22.264470 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:22.264423    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" podStartSLOduration=2.264405005 podStartE2EDuration="2.264405005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:19:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:19:22.263585904 +0000 UTC m=+1689.192869823" watchObservedRunningTime="2026-07-28 13:19:22.264405005 +0000 UTC m=+1689.193688924"
Jul 28 13:19:22.302737 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:22.302696    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:22.308173 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:22.308149    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:23.249212 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:23.249181    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:23.250165 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:23.250135    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:23.632577 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:23.632546    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:23.724177 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:23.724145    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:23.824703 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:23.824674    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:23.968329 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:23.968250    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:24.434251 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.434214    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"]
Jul 28 13:19:24.438302 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.438274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:19:24.441536 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.441511    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0142f26b-dockercfg-467qq\""
Jul 28 13:19:24.441536 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.441511    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0142f26b\""
Jul 28 13:19:24.447098 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.446864    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"]
Jul 28 13:19:24.453521 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.453499    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"]
Jul 28 13:19:24.456855 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.456833    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:19:24.457486 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.457468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lgcb\" (UniqueName: \"kubernetes.io/projected/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-kube-api-access-5lgcb\") pod \"payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz\" (UID: \"20e1a4f7-36f8-4070-bbb8-aacc3cac463b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:19:24.457580 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.457507    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz\" (UID: \"20e1a4f7-36f8-4070-bbb8-aacc3cac463b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:19:24.466955 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.466898    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"]
Jul 28 13:19:24.558662 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.558617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67fe1883-8589-479e-9136-70e3380367dd-plugins-config-volume\") pod \"payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz\" (UID: \"67fe1883-8589-479e-9136-70e3380367dd\") " pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:19:24.558823 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.558687    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz\" (UID: \"20e1a4f7-36f8-4070-bbb8-aacc3cac463b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:19:24.558823 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.558818    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcqx9\" (UniqueName: \"kubernetes.io/projected/67fe1883-8589-479e-9136-70e3380367dd-kube-api-access-dcqx9\") pod \"payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz\" (UID: \"67fe1883-8589-479e-9136-70e3380367dd\") " pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:19:24.558992 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.558872    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lgcb\" (UniqueName: \"kubernetes.io/projected/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-kube-api-access-5lgcb\") pod \"payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz\" (UID: \"20e1a4f7-36f8-4070-bbb8-aacc3cac463b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:19:24.559609 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.559584    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz\" (UID: \"20e1a4f7-36f8-4070-bbb8-aacc3cac463b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:19:24.566859 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.566831    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lgcb\" (UniqueName: \"kubernetes.io/projected/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-kube-api-access-5lgcb\") pod \"payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz\" (UID: \"20e1a4f7-36f8-4070-bbb8-aacc3cac463b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:19:24.659837 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.659804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcqx9\" (UniqueName: \"kubernetes.io/projected/67fe1883-8589-479e-9136-70e3380367dd-kube-api-access-dcqx9\") pod \"payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz\" (UID: \"67fe1883-8589-479e-9136-70e3380367dd\") " pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:19:24.660043 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.659858    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67fe1883-8589-479e-9136-70e3380367dd-plugins-config-volume\") pod \"payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz\" (UID: \"67fe1883-8589-479e-9136-70e3380367dd\") " pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:19:24.660590 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.660570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67fe1883-8589-479e-9136-70e3380367dd-plugins-config-volume\") pod \"payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz\" (UID: \"67fe1883-8589-479e-9136-70e3380367dd\") " pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:19:24.669086 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.669062    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcqx9\" (UniqueName: \"kubernetes.io/projected/67fe1883-8589-479e-9136-70e3380367dd-kube-api-access-dcqx9\") pod \"payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz\" (UID: \"67fe1883-8589-479e-9136-70e3380367dd\") " pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:19:24.689270 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.689190    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:24.751824 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.751785    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:19:24.768415 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.768382    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:19:24.789557 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.789529    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:19:24.909844 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.909702    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"]
Jul 28 13:19:24.948251 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:24.948193    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"]
Jul 28 13:19:24.952160 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:19:24.952119    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fe1883_8589_479e_9136_70e3380367dd.slice/crio-5b9ebdf0d43a0f544c666553e20e4516038f8a0a72c776958f2eb5406052ff29 WatchSource:0}: Error finding container 5b9ebdf0d43a0f544c666553e20e4516038f8a0a72c776958f2eb5406052ff29: Status 404 returned error can't find the container with id 5b9ebdf0d43a0f544c666553e20e4516038f8a0a72c776958f2eb5406052ff29
Jul 28 13:19:25.261730 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:25.261612    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz" event={"ID":"67fe1883-8589-479e-9136-70e3380367dd","Type":"ContainerStarted","Data":"d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74"}
Jul 28 13:19:25.261730 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:25.261679    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz" event={"ID":"67fe1883-8589-479e-9136-70e3380367dd","Type":"ContainerStarted","Data":"5b9ebdf0d43a0f544c666553e20e4516038f8a0a72c776958f2eb5406052ff29"}
Jul 28 13:19:25.262291 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:25.261811    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:19:25.263467 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:25.263432    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz" event={"ID":"20e1a4f7-36f8-4070-bbb8-aacc3cac463b","Type":"ContainerStarted","Data":"b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a"}
Jul 28 13:19:25.263590 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:25.263493    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz" event={"ID":"20e1a4f7-36f8-4070-bbb8-aacc3cac463b","Type":"ContainerStarted","Data":"6370a05bbccb63f652537ee9c14eb487956b85c27f71ca22138a524b6100b521"}
Jul 28 13:19:25.263650 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:25.263630    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:19:25.279415 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:25.279357    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz" podStartSLOduration=1.279339711 podStartE2EDuration="1.279339711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:19:25.277345402 +0000 UTC m=+1692.206629321" watchObservedRunningTime="2026-07-28 13:19:25.279339711 +0000 UTC m=+1692.208623628"
Jul 28 13:19:25.292349 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:25.292296    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz" podStartSLOduration=1.29228024 podStartE2EDuration="1.29228024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:19:25.291573653 +0000 UTC m=+1692.220857574" watchObservedRunningTime="2026-07-28 13:19:25.29228024 +0000 UTC m=+1692.221564157"
Jul 28 13:19:36.271152 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:36.271073    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:19:36.271594 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:36.271200    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:19:39.279789 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:39.279025    2567 patch_prober.go:28] interesting pod/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 13:19:39.279789 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:39.279105    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 13:19:39.350173 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:39.350131    2567 generic.go:356] "Generic (PLEG): container finished" podID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerID="db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d" exitCode=0
Jul 28 13:19:39.350353 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:39.350212    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" event={"ID":"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96","Type":"ContainerDied","Data":"db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d"}
Jul 28 13:19:39.350617 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:39.350604    2567 scope.go:117] "RemoveContainer" containerID="db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d"
Jul 28 13:19:39.351620 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:39.351586    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:19:39.351723 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:39.351659    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:19:39.351723 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:39.351693    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:19:40.359526 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:40.359484    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" event={"ID":"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96","Type":"ContainerStarted","Data":"711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2"}
Jul 28 13:19:41.303425 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:41.303392    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:41.303653 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:41.303634    2567 patch_prober.go:28] interesting pod/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 28 13:19:41.303699 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:41.303680    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 28 13:19:42.303424 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:42.303387    2567 patch_prober.go:28] interesting pod/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 28 13:19:42.303834 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:42.303452    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 28 13:19:43.302792 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:43.302756    2567 patch_prober.go:28] interesting pod/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 28 13:19:43.303019 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:43.302820    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 28 13:19:44.303028 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:44.302992    2567 patch_prober.go:28] interesting pod/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 28 13:19:44.303444 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:44.303047    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 28 13:19:45.307321 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:45.307289    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:45.307782 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:45.307568    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:19:45.308283 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:19:45.308266    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:20:14.414788 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.414754    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:14.445047 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.445008    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"]
Jul 28 13:20:14.445302 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.445273    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz" podUID="67fe1883-8589-479e-9136-70e3380367dd" containerName="payload-processing" containerID="cri-o://d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74" gracePeriod=30
Jul 28 13:20:14.451652 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.451580    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"]
Jul 28 13:20:14.451833 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.451793    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz" podUID="20e1a4f7-36f8-4070-bbb8-aacc3cac463b" containerName="payload-pre-processing" containerID="cri-o://b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a" gracePeriod=30
Jul 28 13:20:14.488827 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.488795    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:14.559648 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.559610    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:14.621765 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.621598    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:14.721509 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.721479    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:20:14.752627 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.752597    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"]
Jul 28 13:20:14.753060 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.752847    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy" containerID="cri-o://711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2" gracePeriod=30
Jul 28 13:20:14.763025 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.763000    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:20:14.766330 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.766294    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:14.837751 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.837711    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-plugins-config-volume\") pod \"20e1a4f7-36f8-4070-bbb8-aacc3cac463b\" (UID: \"20e1a4f7-36f8-4070-bbb8-aacc3cac463b\") "
Jul 28 13:20:14.837982 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.837793    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67fe1883-8589-479e-9136-70e3380367dd-plugins-config-volume\") pod \"67fe1883-8589-479e-9136-70e3380367dd\" (UID: \"67fe1883-8589-479e-9136-70e3380367dd\") "
Jul 28 13:20:14.837982 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.837817    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lgcb\" (UniqueName: \"kubernetes.io/projected/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-kube-api-access-5lgcb\") pod \"20e1a4f7-36f8-4070-bbb8-aacc3cac463b\" (UID: \"20e1a4f7-36f8-4070-bbb8-aacc3cac463b\") "
Jul 28 13:20:14.837982 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.837849    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcqx9\" (UniqueName: \"kubernetes.io/projected/67fe1883-8589-479e-9136-70e3380367dd-kube-api-access-dcqx9\") pod \"67fe1883-8589-479e-9136-70e3380367dd\" (UID: \"67fe1883-8589-479e-9136-70e3380367dd\") "
Jul 28 13:20:14.838193 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.838165    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67fe1883-8589-479e-9136-70e3380367dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "67fe1883-8589-479e-9136-70e3380367dd" (UID: "67fe1883-8589-479e-9136-70e3380367dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:20:14.838193 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.838181    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "20e1a4f7-36f8-4070-bbb8-aacc3cac463b" (UID: "20e1a4f7-36f8-4070-bbb8-aacc3cac463b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:20:14.839963 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.839931    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67fe1883-8589-479e-9136-70e3380367dd-kube-api-access-dcqx9" (OuterVolumeSpecName: "kube-api-access-dcqx9") pod "67fe1883-8589-479e-9136-70e3380367dd" (UID: "67fe1883-8589-479e-9136-70e3380367dd"). InnerVolumeSpecName "kube-api-access-dcqx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:20:14.840109 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.839997    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-kube-api-access-5lgcb" (OuterVolumeSpecName: "kube-api-access-5lgcb") pod "20e1a4f7-36f8-4070-bbb8-aacc3cac463b" (UID: "20e1a4f7-36f8-4070-bbb8-aacc3cac463b"). InnerVolumeSpecName "kube-api-access-5lgcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:20:14.938856 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.938758    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:14.938856 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.938792    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67fe1883-8589-479e-9136-70e3380367dd-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:14.938856 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.938805    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lgcb\" (UniqueName: \"kubernetes.io/projected/20e1a4f7-36f8-4070-bbb8-aacc3cac463b-kube-api-access-5lgcb\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:14.938856 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.938818    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcqx9\" (UniqueName: \"kubernetes.io/projected/67fe1883-8589-479e-9136-70e3380367dd-kube-api-access-dcqx9\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:14.990280 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:14.990248    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:15.236775 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.236674    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:15.310004 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.309965    2567 patch_prober.go:28] interesting pod/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 13:20:15.310186 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.310021    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 13:20:15.354283 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.354251    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:15.502984 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.502864    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:15.568245 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.568209    2567 generic.go:356] "Generic (PLEG): container finished" podID="67fe1883-8589-479e-9136-70e3380367dd" containerID="d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74" exitCode=0
Jul 28 13:20:15.568416 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.568274    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"
Jul 28 13:20:15.568416 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.568306    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz" event={"ID":"67fe1883-8589-479e-9136-70e3380367dd","Type":"ContainerDied","Data":"d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74"}
Jul 28 13:20:15.568416 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.568393    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz" event={"ID":"67fe1883-8589-479e-9136-70e3380367dd","Type":"ContainerDied","Data":"5b9ebdf0d43a0f544c666553e20e4516038f8a0a72c776958f2eb5406052ff29"}
Jul 28 13:20:15.568595 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.568425    2567 scope.go:117] "RemoveContainer" containerID="d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74"
Jul 28 13:20:15.569860 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.569837    2567 generic.go:356] "Generic (PLEG): container finished" podID="20e1a4f7-36f8-4070-bbb8-aacc3cac463b" containerID="b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a" exitCode=0
Jul 28 13:20:15.569954 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.569873    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz" event={"ID":"20e1a4f7-36f8-4070-bbb8-aacc3cac463b","Type":"ContainerDied","Data":"b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a"}
Jul 28 13:20:15.569954 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.569907    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz" event={"ID":"20e1a4f7-36f8-4070-bbb8-aacc3cac463b","Type":"ContainerDied","Data":"6370a05bbccb63f652537ee9c14eb487956b85c27f71ca22138a524b6100b521"}
Jul 28 13:20:15.569954 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.569913    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"
Jul 28 13:20:15.577767 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.577749    2567 scope.go:117] "RemoveContainer" containerID="d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74"
Jul 28 13:20:15.578076 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:20:15.578055    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74\": container with ID starting with d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74 not found: ID does not exist" containerID="d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74"
Jul 28 13:20:15.578160 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.578084    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74"} err="failed to get container status \"d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74\": rpc error: code = NotFound desc = could not find container \"d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74\": container with ID starting with d6d4920300c88c4d0b6bd864cf3c266a98f99fa47395e24c5cdd9f77824dbd74 not found: ID does not exist"
Jul 28 13:20:15.578160 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.578102    2567 scope.go:117] "RemoveContainer" containerID="b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a"
Jul 28 13:20:15.586662 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.586641    2567 scope.go:117] "RemoveContainer" containerID="b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a"
Jul 28 13:20:15.586998 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:20:15.586978    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a\": container with ID starting with b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a not found: ID does not exist" containerID="b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a"
Jul 28 13:20:15.587070 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.587004    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a"} err="failed to get container status \"b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a\": rpc error: code = NotFound desc = could not find container \"b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a\": container with ID starting with b1c4f1089191f3eeba1c633957b1e4ca03001181a8137ab10211b7cc506e396a not found: ID does not exist"
Jul 28 13:20:15.588499 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.588479    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"]
Jul 28 13:20:15.591891 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.591860    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0142f26b-69c68467b-fmfrz"]
Jul 28 13:20:15.605231 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.605200    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"]
Jul 28 13:20:15.609542 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.609514    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0142f26b-74588fb78b-h4psz"]
Jul 28 13:20:15.782399 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.782366    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"]
Jul 28 13:20:15.782843 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.782824    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67fe1883-8589-479e-9136-70e3380367dd" containerName="payload-processing"
Jul 28 13:20:15.782843 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.782843    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="67fe1883-8589-479e-9136-70e3380367dd" containerName="payload-processing"
Jul 28 13:20:15.783013 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.782868    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e1a4f7-36f8-4070-bbb8-aacc3cac463b" containerName="payload-pre-processing"
Jul 28 13:20:15.783013 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.782874    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e1a4f7-36f8-4070-bbb8-aacc3cac463b" containerName="payload-pre-processing"
Jul 28 13:20:15.783013 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.782953    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e1a4f7-36f8-4070-bbb8-aacc3cac463b" containerName="payload-pre-processing"
Jul 28 13:20:15.783013 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.782963    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="67fe1883-8589-479e-9136-70e3380367dd" containerName="payload-processing"
Jul 28 13:20:15.787220 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.787197    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.791839 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.791817    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d771891a-gw-openshift-default-dockercfg-2njjb\""
Jul 28 13:20:15.804287 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.804259    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"]
Jul 28 13:20:15.807752 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.807721    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:15.847540 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.847502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-token\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.847728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.847546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-podinfo\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.847728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.847580    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-data\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.847728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.847606    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7929bf05-63a5-4a0e-9271-b30fb26d5791-istiod-ca-cert\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.847728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.847636    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-certs\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.847728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.847695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-envoy\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.847728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.847721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb67t\" (UniqueName: \"kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-kube-api-access-rb67t\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.847959 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.847799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-socket\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.847959 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.847830    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-credential-socket\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.948800 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.948754    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-token\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.948800 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.948800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-podinfo\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949112 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.948821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-data\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949112 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.948974    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7929bf05-63a5-4a0e-9271-b30fb26d5791-istiod-ca-cert\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949112 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.949026    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-certs\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949287 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.949155    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-envoy\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949287 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.949197    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb67t\" (UniqueName: \"kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-kube-api-access-rb67t\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949287 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.949234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-socket\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949287 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.949271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-credential-socket\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949491 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.949335    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-data\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949491 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.949423    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-certs\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949607 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.949579    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-socket\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949668 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.949620    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-credential-socket\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.949742 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.949722    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7929bf05-63a5-4a0e-9271-b30fb26d5791-istiod-ca-cert\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.951447 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.951423    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-envoy\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.951649 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.951632    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-podinfo\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.957205 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.957184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-token\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:15.957437 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:15.957416    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb67t\" (UniqueName: \"kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-kube-api-access-rb67t\") pod \"e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") " pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:16.097004 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:16.096885    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:16.155515 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:16.155472    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:16.246044 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:16.246016    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"]
Jul 28 13:20:16.247204 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:20:16.247181    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7929bf05_63a5_4a0e_9271_b30fb26d5791.slice/crio-5a99c26edf9b7d50aa5fb0f9383fbaebc44c24a102fa222438890a4e36c575d5 WatchSource:0}: Error finding container 5a99c26edf9b7d50aa5fb0f9383fbaebc44c24a102fa222438890a4e36c575d5: Status 404 returned error can't find the container with id 5a99c26edf9b7d50aa5fb0f9383fbaebc44c24a102fa222438890a4e36c575d5
Jul 28 13:20:16.249468 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:16.249438    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:20:16.249546 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:16.249509    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:20:16.249591 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:16.249569    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:20:16.578634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:16.578594    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" event={"ID":"7929bf05-63a5-4a0e-9271-b30fb26d5791","Type":"ContainerStarted","Data":"781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd"}
Jul 28 13:20:16.579183 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:16.578659    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" event={"ID":"7929bf05-63a5-4a0e-9271-b30fb26d5791","Type":"ContainerStarted","Data":"5a99c26edf9b7d50aa5fb0f9383fbaebc44c24a102fa222438890a4e36c575d5"}
Jul 28 13:20:16.599595 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:16.599530    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" podStartSLOduration=1.599510548 podStartE2EDuration="1.599510548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:20:16.599160837 +0000 UTC m=+1743.528444755" watchObservedRunningTime="2026-07-28 13:20:16.599510548 +0000 UTC m=+1743.528794466"
Jul 28 13:20:17.097187 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:17.097154    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:17.098662 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:17.098638    2567 patch_prober.go:28] interesting pod/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 28 13:20:17.098766 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:17.098687    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 28 13:20:17.502173 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:17.502084    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e1a4f7-36f8-4070-bbb8-aacc3cac463b" path="/var/lib/kubelet/pods/20e1a4f7-36f8-4070-bbb8-aacc3cac463b/volumes"
Jul 28 13:20:17.502466 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:17.502452    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67fe1883-8589-479e-9136-70e3380367dd" path="/var/lib/kubelet/pods/67fe1883-8589-479e-9136-70e3380367dd/volumes"
Jul 28 13:20:18.067527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:18.067491    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:18.101642 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:18.101609    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:18.352538 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:18.352453    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:18.591229 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:18.591200    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:18.592354 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:18.592331    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:18.761903 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:18.761810    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:18.865643 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:18.865612    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:18.940078 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:18.940048    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:20.017087 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.017064    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:20:20.090126 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090092    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5zg5\" (UniqueName: \"kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-kube-api-access-j5zg5\") pod \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") "
Jul 28 13:20:20.090313 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090152    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-data\") pod \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") "
Jul 28 13:20:20.090313 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090217    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-token\") pod \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") "
Jul 28 13:20:20.090313 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090242    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istiod-ca-cert\") pod \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") "
Jul 28 13:20:20.090313 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090265    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-socket\") pod \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") "
Jul 28 13:20:20.090547 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090320    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-credential-socket\") pod \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") "
Jul 28 13:20:20.090547 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090385    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-envoy\") pod \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") "
Jul 28 13:20:20.090547 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090424    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-podinfo\") pod \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") "
Jul 28 13:20:20.090547 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090459    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-certs\") pod \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\" (UID: \"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96\") "
Jul 28 13:20:20.090727 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090678    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" (UID: "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:20:20.090791 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090737    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" (UID: "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:20:20.090853 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090808    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:20.090956 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.090910    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" (UID: "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:20:20.091031 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.091010    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" (UID: "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:20:20.091344 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.091310    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-data" (OuterVolumeSpecName: "istio-data") pod "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" (UID: "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:20:20.092575 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.092543    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-token" (OuterVolumeSpecName: "istio-token") pod "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" (UID: "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:20:20.092575 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.092558    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-kube-api-access-j5zg5" (OuterVolumeSpecName: "kube-api-access-j5zg5") pod "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" (UID: "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96"). InnerVolumeSpecName "kube-api-access-j5zg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:20:20.092704 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.092596    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" (UID: "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:20:20.092814 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.092798    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" (UID: "a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:20:20.191592 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.191552    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-podinfo\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:20.191592 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.191584    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-workload-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:20.191592 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.191597    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5zg5\" (UniqueName: \"kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-kube-api-access-j5zg5\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:20.191838 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.191606    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-data\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:20.191838 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.191614    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:20.191838 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.191622    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istiod-ca-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:20.191838 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.191630    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-credential-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:20.191838 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.191638    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96-istio-envoy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:20.603897 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.603862    2567 generic.go:356] "Generic (PLEG): container finished" podID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerID="711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2" exitCode=0
Jul 28 13:20:20.604117 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.603931    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"
Jul 28 13:20:20.604117 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.603952    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" event={"ID":"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96","Type":"ContainerDied","Data":"711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2"}
Jul 28 13:20:20.604117 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.604022    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf" event={"ID":"a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96","Type":"ContainerDied","Data":"74e088d0e5a7ed5249c72f5d07b8d7c425813f1be7a9bf1c0eab653e88773a60"}
Jul 28 13:20:20.604117 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.604038    2567 scope.go:117] "RemoveContainer" containerID="711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2"
Jul 28 13:20:20.617014 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.616989    2567 scope.go:117] "RemoveContainer" containerID="db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d"
Jul 28 13:20:20.625433 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.625409    2567 scope.go:117] "RemoveContainer" containerID="711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2"
Jul 28 13:20:20.625714 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:20:20.625694    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2\": container with ID starting with 711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2 not found: ID does not exist" containerID="711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2"
Jul 28 13:20:20.625785 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.625729    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2"} err="failed to get container status \"711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2\": rpc error: code = NotFound desc = could not find container \"711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2\": container with ID starting with 711fab416bd5a26b7b3800ba12b0b8d9314cbd31a5fb506d3c1695520b6afed2 not found: ID does not exist"
Jul 28 13:20:20.625785 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.625748    2567 scope.go:117] "RemoveContainer" containerID="db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d"
Jul 28 13:20:20.626106 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:20:20.626083    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d\": container with ID starting with db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d not found: ID does not exist" containerID="db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d"
Jul 28 13:20:20.626195 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.626114    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d"} err="failed to get container status \"db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d\": rpc error: code = NotFound desc = could not find container \"db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d\": container with ID starting with db795548b386588fd1721095195291390bfb156dd4033643efeaac52c1e4946d not found: ID does not exist"
Jul 28 13:20:20.629348 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.629325    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"]
Jul 28 13:20:20.634437 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:20.634410    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0142f26b-openshift-default-6b485fb474-5dmcf"]
Jul 28 13:20:21.501861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:21.501819    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" path="/var/lib/kubelet/pods/a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96/volumes"
Jul 28 13:20:32.684858 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:32.684822    2567 generic.go:356] "Generic (PLEG): container finished" podID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerID="781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd" exitCode=0
Jul 28 13:20:32.685291 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:32.684897    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" event={"ID":"7929bf05-63a5-4a0e-9271-b30fb26d5791","Type":"ContainerDied","Data":"781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd"}
Jul 28 13:20:32.685337 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:32.685298    2567 scope.go:117] "RemoveContainer" containerID="781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd"
Jul 28 13:20:32.686294 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:32.686267    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:20:32.686361 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:32.686334    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:20:32.686397 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:32.686365    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:20:33.591488 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:33.591454    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:33.691659 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:33.691624    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" event={"ID":"7929bf05-63a5-4a0e-9271-b30fb26d5791","Type":"ContainerStarted","Data":"2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489"}
Jul 28 13:20:34.097246 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:34.097212    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:34.098352 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:34.098327    2567 patch_prober.go:28] interesting pod/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 28 13:20:34.098439 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:34.098407    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 28 13:20:35.098115 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:35.098075    2567 patch_prober.go:28] interesting pod/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 28 13:20:35.098525 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:35.098132    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 28 13:20:36.098040 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:36.098001    2567 patch_prober.go:28] interesting pod/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 28 13:20:36.098237 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:36.098065    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 28 13:20:37.097700 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:37.097668    2567 patch_prober.go:28] interesting pod/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 28 13:20:37.097873 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:37.097725    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 28 13:20:38.101761 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:38.101733    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:38.102200 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:38.102181    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:38.102954 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:38.102912    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:43.097090 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.097052    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"]
Jul 28 13:20:43.097501 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.097465    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy"
Jul 28 13:20:43.097501 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.097477    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy"
Jul 28 13:20:43.097501 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.097488    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy"
Jul 28 13:20:43.097501 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.097493    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy"
Jul 28 13:20:43.097647 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.097561    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy"
Jul 28 13:20:43.097647 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.097571    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a42a0dd0-1c3d-4cc6-ae56-845c4ae38e96" containerName="istio-proxy"
Jul 28 13:20:43.101123 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.101105    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"
Jul 28 13:20:43.103726 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.103697    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 13:20:43.103856 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.103748    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6qfh\""
Jul 28 13:20:43.110385 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.110355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427aaf9c-6dda-4948-bbd3-af605a32948d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d771891a-59qd6\" (UID: \"427aaf9c-6dda-4948-bbd3-af605a32948d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"
Jul 28 13:20:43.113031 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.113005    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"]
Jul 28 13:20:43.211821 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.211781    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427aaf9c-6dda-4948-bbd3-af605a32948d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d771891a-59qd6\" (UID: \"427aaf9c-6dda-4948-bbd3-af605a32948d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"
Jul 28 13:20:43.212468 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.212447    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427aaf9c-6dda-4948-bbd3-af605a32948d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d771891a-59qd6\" (UID: \"427aaf9c-6dda-4948-bbd3-af605a32948d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"
Jul 28 13:20:43.412079 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.411990    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"
Jul 28 13:20:43.552071 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.552039    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"]
Jul 28 13:20:43.553714 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:20:43.553679    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427aaf9c_6dda_4948_bbd3_af605a32948d.slice/crio-8b4990a9634b557781965d91783b9b894648b13deaa5d314518b3506eae6c5e3 WatchSource:0}: Error finding container 8b4990a9634b557781965d91783b9b894648b13deaa5d314518b3506eae6c5e3: Status 404 returned error can't find the container with id 8b4990a9634b557781965d91783b9b894648b13deaa5d314518b3506eae6c5e3
Jul 28 13:20:43.750625 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:43.750592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6" event={"ID":"427aaf9c-6dda-4948-bbd3-af605a32948d","Type":"ContainerStarted","Data":"8b4990a9634b557781965d91783b9b894648b13deaa5d314518b3506eae6c5e3"}
Jul 28 13:20:44.757411 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:44.757379    2567 generic.go:356] "Generic (PLEG): container finished" podID="427aaf9c-6dda-4948-bbd3-af605a32948d" containerID="4ed9a16dcf73877acf0eda9a80e3b64c5484f1ffce3831bd4f7241d2f16f945b" exitCode=0
Jul 28 13:20:44.757846 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:44.757421    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6" event={"ID":"427aaf9c-6dda-4948-bbd3-af605a32948d","Type":"ContainerDied","Data":"4ed9a16dcf73877acf0eda9a80e3b64c5484f1ffce3831bd4f7241d2f16f945b"}
Jul 28 13:20:45.899493 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:45.899465    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"
Jul 28 13:20:45.935312 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:45.935275    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427aaf9c-6dda-4948-bbd3-af605a32948d-maas-api-service-ca\") pod \"427aaf9c-6dda-4948-bbd3-af605a32948d\" (UID: \"427aaf9c-6dda-4948-bbd3-af605a32948d\") "
Jul 28 13:20:45.935632 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:45.935609    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/427aaf9c-6dda-4948-bbd3-af605a32948d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "427aaf9c-6dda-4948-bbd3-af605a32948d" (UID: "427aaf9c-6dda-4948-bbd3-af605a32948d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:20:46.036323 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:46.036294    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/427aaf9c-6dda-4948-bbd3-af605a32948d-maas-api-service-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:46.770213 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:46.770173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6" event={"ID":"427aaf9c-6dda-4948-bbd3-af605a32948d","Type":"ContainerDied","Data":"8b4990a9634b557781965d91783b9b894648b13deaa5d314518b3506eae6c5e3"}
Jul 28 13:20:46.770213 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:46.770193    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"
Jul 28 13:20:46.770477 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:46.770224    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b4990a9634b557781965d91783b9b894648b13deaa5d314518b3506eae6c5e3"
Jul 28 13:20:49.019149 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.019103    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:49.100109 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.100085    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:49.168256 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.168226    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:49.225602 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.225567    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"]
Jul 28 13:20:49.228276 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.228250    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d771891a-59qd6"]
Jul 28 13:20:49.242937 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.242878    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:49.356793 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.356705    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"]
Jul 28 13:20:49.357037 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.356981    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy" containerID="cri-o://2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489" gracePeriod=30
Jul 28 13:20:49.379048 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.379015    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:49.500850 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.500803    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="427aaf9c-6dda-4948-bbd3-af605a32948d" path="/var/lib/kubelet/pods/427aaf9c-6dda-4948-bbd3-af605a32948d/volumes"
Jul 28 13:20:49.621402 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.621317    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:49.871956 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:49.871849    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:50.171214 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.171123    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"]
Jul 28 13:20:50.171672 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.171517    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427aaf9c-6dda-4948-bbd3-af605a32948d" containerName="revoke-keys"
Jul 28 13:20:50.171672 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.171528    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="427aaf9c-6dda-4948-bbd3-af605a32948d" containerName="revoke-keys"
Jul 28 13:20:50.171672 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.171594    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="427aaf9c-6dda-4948-bbd3-af605a32948d" containerName="revoke-keys"
Jul 28 13:20:50.174854 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.174832    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.178322 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.178302    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-72ce9b01-openshift-default-dockercfg-kh2w4\""
Jul 28 13:20:50.187425 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.187390    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"]
Jul 28 13:20:50.220155 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.220103    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:50.276006 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.275964    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-token\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.276201 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.276027    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-podinfo\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.276201 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.276064    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-socket\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.276201 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.276092    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-data\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.276201 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.276114    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004a868c-e1fc-422a-b8a2-f6586e05f33f-istiod-ca-cert\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.276201 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.276133    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-envoy\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.276471 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.276232    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-certs\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.276471 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.276291    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-credential-socket\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.276471 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.276346    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52gcv\" (UniqueName: \"kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-kube-api-access-52gcv\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.377458 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.377421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-token\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.377640 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.377569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-podinfo\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.377640 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.377608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-socket\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.377721 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.377648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-data\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.377721 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.377672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004a868c-e1fc-422a-b8a2-f6586e05f33f-istiod-ca-cert\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.377721 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.377695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-envoy\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.377884 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.377731    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-certs\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.377884 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.377775    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-credential-socket\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.377884 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.377817    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52gcv\" (UniqueName: \"kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-kube-api-access-52gcv\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.378189 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.378162    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-socket\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.378189 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.378179    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-certs\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.378341 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.378249    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-credential-socket\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.378406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.378370    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-data\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.378837 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.378812    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004a868c-e1fc-422a-b8a2-f6586e05f33f-istiod-ca-cert\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.380025 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.380007    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-envoy\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.380556 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.380534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-podinfo\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.386442 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.386408    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-token\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.386612 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.386591    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52gcv\" (UniqueName: \"kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-kube-api-access-52gcv\") pod \"e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") " pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.485541 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.485450    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:50.507687 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.507652    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:50.633242 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.633216    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"]
Jul 28 13:20:50.636463 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:20:50.636430    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004a868c_e1fc_422a_b8a2_f6586e05f33f.slice/crio-535a79ade5db84d3875983a5c4d17ce4791b8f1cddd46c7dfe5fb326b20c9243 WatchSource:0}: Error finding container 535a79ade5db84d3875983a5c4d17ce4791b8f1cddd46c7dfe5fb326b20c9243: Status 404 returned error can't find the container with id 535a79ade5db84d3875983a5c4d17ce4791b8f1cddd46c7dfe5fb326b20c9243
Jul 28 13:20:50.638808 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.638773    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:20:50.638902 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.638855    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:20:50.638976 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.638898    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:20:50.794835 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.794779    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" event={"ID":"004a868c-e1fc-422a-b8a2-f6586e05f33f","Type":"ContainerStarted","Data":"6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32"}
Jul 28 13:20:50.795082 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.794853    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" event={"ID":"004a868c-e1fc-422a-b8a2-f6586e05f33f","Type":"ContainerStarted","Data":"535a79ade5db84d3875983a5c4d17ce4791b8f1cddd46c7dfe5fb326b20c9243"}
Jul 28 13:20:50.816221 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:50.816167    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" podStartSLOduration=0.816147058 podStartE2EDuration="816.147058ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:20:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:20:50.814965774 +0000 UTC m=+1777.744249686" watchObservedRunningTime="2026-07-28 13:20:50.816147058 +0000 UTC m=+1777.745430975"
Jul 28 13:20:51.486106 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:51.486068    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:51.490693 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:51.490666    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:51.800601 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:51.800578    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:51.801579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:51.801555    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:20:52.169595 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:52.169502    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:52.252231 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:52.252201    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:52.321296 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:52.321267    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:52.462480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:52.462398    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:52.864047 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:52.864020    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:52.963126 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:52.963090    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:20:53.105645 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:53.105560    2567 patch_prober.go:28] interesting pod/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 13:20:53.105645 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:53.105626    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 13:20:54.620617 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.620545    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:54.718358 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718329    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-envoy\") pod \"7929bf05-63a5-4a0e-9271-b30fb26d5791\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") "
Jul 28 13:20:54.718358 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718367    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-certs\") pod \"7929bf05-63a5-4a0e-9271-b30fb26d5791\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") "
Jul 28 13:20:54.718625 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718395    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-socket\") pod \"7929bf05-63a5-4a0e-9271-b30fb26d5791\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") "
Jul 28 13:20:54.718625 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718419    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-credential-socket\") pod \"7929bf05-63a5-4a0e-9271-b30fb26d5791\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") "
Jul 28 13:20:54.718625 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718446    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7929bf05-63a5-4a0e-9271-b30fb26d5791-istiod-ca-cert\") pod \"7929bf05-63a5-4a0e-9271-b30fb26d5791\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") "
Jul 28 13:20:54.718625 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718494    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-podinfo\") pod \"7929bf05-63a5-4a0e-9271-b30fb26d5791\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") "
Jul 28 13:20:54.718625 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718540    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-data\") pod \"7929bf05-63a5-4a0e-9271-b30fb26d5791\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") "
Jul 28 13:20:54.718625 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718573    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-token\") pod \"7929bf05-63a5-4a0e-9271-b30fb26d5791\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") "
Jul 28 13:20:54.718625 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718623    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb67t\" (UniqueName: \"kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-kube-api-access-rb67t\") pod \"7929bf05-63a5-4a0e-9271-b30fb26d5791\" (UID: \"7929bf05-63a5-4a0e-9271-b30fb26d5791\") "
Jul 28 13:20:54.719012 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718722    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7929bf05-63a5-4a0e-9271-b30fb26d5791" (UID: "7929bf05-63a5-4a0e-9271-b30fb26d5791"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:20:54.719012 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718742    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7929bf05-63a5-4a0e-9271-b30fb26d5791" (UID: "7929bf05-63a5-4a0e-9271-b30fb26d5791"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:20:54.719012 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718852    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7929bf05-63a5-4a0e-9271-b30fb26d5791" (UID: "7929bf05-63a5-4a0e-9271-b30fb26d5791"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:20:54.719012 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.718982    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7929bf05-63a5-4a0e-9271-b30fb26d5791-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7929bf05-63a5-4a0e-9271-b30fb26d5791" (UID: "7929bf05-63a5-4a0e-9271-b30fb26d5791"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:20:54.719223 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.719042    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:54.719223 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.719065    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-workload-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:54.719223 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.719081    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-credential-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:54.719749 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.719722    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-data" (OuterVolumeSpecName: "istio-data") pod "7929bf05-63a5-4a0e-9271-b30fb26d5791" (UID: "7929bf05-63a5-4a0e-9271-b30fb26d5791"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:20:54.720802 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.720774    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7929bf05-63a5-4a0e-9271-b30fb26d5791" (UID: "7929bf05-63a5-4a0e-9271-b30fb26d5791"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:20:54.720894 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.720807    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7929bf05-63a5-4a0e-9271-b30fb26d5791" (UID: "7929bf05-63a5-4a0e-9271-b30fb26d5791"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:20:54.720894 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.720819    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-token" (OuterVolumeSpecName: "istio-token") pod "7929bf05-63a5-4a0e-9271-b30fb26d5791" (UID: "7929bf05-63a5-4a0e-9271-b30fb26d5791"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:20:54.720894 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.720832    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-kube-api-access-rb67t" (OuterVolumeSpecName: "kube-api-access-rb67t") pod "7929bf05-63a5-4a0e-9271-b30fb26d5791" (UID: "7929bf05-63a5-4a0e-9271-b30fb26d5791"). InnerVolumeSpecName "kube-api-access-rb67t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:20:54.819038 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819001    2567 generic.go:356] "Generic (PLEG): container finished" podID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerID="2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489" exitCode=0
Jul 28 13:20:54.819239 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819053    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"
Jul 28 13:20:54.819239 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819088    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" event={"ID":"7929bf05-63a5-4a0e-9271-b30fb26d5791","Type":"ContainerDied","Data":"2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489"}
Jul 28 13:20:54.819239 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn" event={"ID":"7929bf05-63a5-4a0e-9271-b30fb26d5791","Type":"ContainerDied","Data":"5a99c26edf9b7d50aa5fb0f9383fbaebc44c24a102fa222438890a4e36c575d5"}
Jul 28 13:20:54.819239 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819215    2567 scope.go:117] "RemoveContainer" containerID="2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489"
Jul 28 13:20:54.819603 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819579    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-envoy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:54.819603 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819603    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7929bf05-63a5-4a0e-9271-b30fb26d5791-istiod-ca-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:54.819794 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819616    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-podinfo\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:54.819794 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819627    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-data\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:54.819794 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819640    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:54.819794 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.819649    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb67t\" (UniqueName: \"kubernetes.io/projected/7929bf05-63a5-4a0e-9271-b30fb26d5791-kube-api-access-rb67t\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:20:54.829032 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.829009    2567 scope.go:117] "RemoveContainer" containerID="781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd"
Jul 28 13:20:54.839959 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.839912    2567 scope.go:117] "RemoveContainer" containerID="2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489"
Jul 28 13:20:54.840244 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:20:54.840227    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489\": container with ID starting with 2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489 not found: ID does not exist" containerID="2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489"
Jul 28 13:20:54.840315 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.840253    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489"} err="failed to get container status \"2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489\": rpc error: code = NotFound desc = could not find container \"2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489\": container with ID starting with 2bbe5cc71114af22bd967495ead4d69199140357f5da5789405bb4b12bca8489 not found: ID does not exist"
Jul 28 13:20:54.840315 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.840270    2567 scope.go:117] "RemoveContainer" containerID="781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd"
Jul 28 13:20:54.840515 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:20:54.840490    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd\": container with ID starting with 781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd not found: ID does not exist" containerID="781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd"
Jul 28 13:20:54.840559 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.840524    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd"} err="failed to get container status \"781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd\": rpc error: code = NotFound desc = could not find container \"781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd\": container with ID starting with 781f5a061bb31d7caad2da715fd6025de2363057e665b8d0e270ab5c452b84cd not found: ID does not exist"
Jul 28 13:20:54.843725 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.843701    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"]
Jul 28 13:20:54.854049 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:54.854025    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d771891a-gw-openshift-default-8666ff79fb-bc5fn"]
Jul 28 13:20:55.501148 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:20:55.501116    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" path="/var/lib/kubelet/pods/7929bf05-63a5-4a0e-9271-b30fb26d5791/volumes"
Jul 28 13:21:07.842150 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:07.842101    2567 patch_prober.go:28] interesting pod/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 13:21:07.842577 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:07.842196    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 13:21:08.904512 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:08.904478    2567 generic.go:356] "Generic (PLEG): container finished" podID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerID="6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32" exitCode=0
Jul 28 13:21:08.905088 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:08.904558    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" event={"ID":"004a868c-e1fc-422a-b8a2-f6586e05f33f","Type":"ContainerDied","Data":"6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32"}
Jul 28 13:21:08.905161 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:08.905131    2567 scope.go:117] "RemoveContainer" containerID="6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32"
Jul 28 13:21:08.906134 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:08.906105    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:21:08.906254 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:08.906178    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:21:08.906254 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:08.906211    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:21:09.912692 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:09.912652    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" event={"ID":"004a868c-e1fc-422a-b8a2-f6586e05f33f","Type":"ContainerStarted","Data":"85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf"}
Jul 28 13:21:10.486186 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:10.486140    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:21:10.486412 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:10.486392    2567 patch_prober.go:28] interesting pod/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 28 13:21:10.486464 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:10.486435    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 28 13:21:11.486364 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:11.486267    2567 patch_prober.go:28] interesting pod/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 28 13:21:11.486364 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:11.486326    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 28 13:21:12.486124 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:12.486086    2567 patch_prober.go:28] interesting pod/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 28 13:21:12.486300 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:12.486161    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 28 13:21:13.486419 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:13.486382    2567 patch_prober.go:28] interesting pod/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 28 13:21:13.486820 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:13.486456    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 28 13:21:14.489825 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:14.489793    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:21:14.490258 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:14.490168    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:21:14.491024 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:14.491006    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:21:22.864466 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:22.864432    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:22.950859 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:22.950829    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:23.033731 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:23.033696    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:23.135662 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:23.135585    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:24.219369 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.219334    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"]
Jul 28 13:21:24.219829 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.219590    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy" containerID="cri-o://85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf" gracePeriod=30
Jul 28 13:21:24.245070 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.245039    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:24.464146 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.464117    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:24.761840 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.761808    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:24.958080 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.958047    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"]
Jul 28 13:21:24.958497 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.958479    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy"
Jul 28 13:21:24.958589 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.958499    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy"
Jul 28 13:21:24.958589 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.958518    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy"
Jul 28 13:21:24.958589 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.958527    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy"
Jul 28 13:21:24.958746 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.958642    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy"
Jul 28 13:21:24.958746 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.958656    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7929bf05-63a5-4a0e-9271-b30fb26d5791" containerName="istio-proxy"
Jul 28 13:21:24.962177 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.962157    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:24.964774 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.964751    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0c0ab0cc-openshift-default-dockercfg-l67mb\""
Jul 28 13:21:24.974874 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.974802    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"]
Jul 28 13:21:24.997841 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:24.997804    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:25.115898 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.115862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-socket\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.116140 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.115976    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-data\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.116140 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.116004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pglgl\" (UniqueName: \"kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-kube-api-access-pglgl\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.116140 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.116031    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-certs\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.116140 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.116053    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-credential-socket\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.116140 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.116096    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-token\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.116320 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.116146    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1375df-0b0d-42f2-b13d-92672e612a76-istiod-ca-cert\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.116320 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.116177    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-envoy\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.116320 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.116201    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-podinfo\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.217686 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.217645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-data\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.217686 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.217693    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pglgl\" (UniqueName: \"kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-kube-api-access-pglgl\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.217990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.217720    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-certs\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.217990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.217753    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-credential-socket\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.217990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.217783    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-token\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.217990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.217808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1375df-0b0d-42f2-b13d-92672e612a76-istiod-ca-cert\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.217990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.217835    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-envoy\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.217990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.217887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-podinfo\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.217990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.217972    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-socket\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.218389 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.218174    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-data\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.218389 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.218185    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-credential-socket\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.218506 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.218383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-socket\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.218664 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.218613    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1375df-0b0d-42f2-b13d-92672e612a76-istiod-ca-cert\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.218828 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.218807    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-certs\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.220234 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.220213    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-envoy\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.220607 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.220452    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-podinfo\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.225740 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.225713    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pglgl\" (UniqueName: \"kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-kube-api-access-pglgl\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.226222 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.226205    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-token\") pod \"e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") " pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.276068 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.276029    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:25.431279 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.431247    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"]
Jul 28 13:21:25.433181 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:21:25.433140    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1375df_0b0d_42f2_b13d_92672e612a76.slice/crio-f2bc8794676197c77a1b628dc62d7d8f8212e615c859a2997b466d2f198a3aad WatchSource:0}: Error finding container f2bc8794676197c77a1b628dc62d7d8f8212e615c859a2997b466d2f198a3aad: Status 404 returned error can't find the container with id f2bc8794676197c77a1b628dc62d7d8f8212e615c859a2997b466d2f198a3aad
Jul 28 13:21:25.435896 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.435856    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:21:25.436033 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.435971    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:21:25.436033 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.436015    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:21:25.637782 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:25.637704    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:26.004770 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:26.004674    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" event={"ID":"ba1375df-0b0d-42f2-b13d-92672e612a76","Type":"ContainerStarted","Data":"6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7"}
Jul 28 13:21:26.004770 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:26.004739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" event={"ID":"ba1375df-0b0d-42f2-b13d-92672e612a76","Type":"ContainerStarted","Data":"f2bc8794676197c77a1b628dc62d7d8f8212e615c859a2997b466d2f198a3aad"}
Jul 28 13:21:26.025873 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:26.025818    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" podStartSLOduration=2.025803335 podStartE2EDuration="2.025803335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:21:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:21:26.025581407 +0000 UTC m=+1812.954865324" watchObservedRunningTime="2026-07-28 13:21:26.025803335 +0000 UTC m=+1812.955087252"
Jul 28 13:21:26.276441 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:26.276399    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:26.281684 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:26.281656    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:27.016464 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:27.016428    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:27.017424 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:27.017401    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:27.390987 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:27.390871    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:27.483563 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:27.483533    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:27.575430 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:27.575389    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:27.834447 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:27.834411    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:28.239930 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:28.239814    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:28.339255 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:28.339220    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:29.484837 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.484770    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:21:29.560677 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.560641    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-token\") pod \"004a868c-e1fc-422a-b8a2-f6586e05f33f\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") "
Jul 28 13:21:29.560863 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.560688    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-socket\") pod \"004a868c-e1fc-422a-b8a2-f6586e05f33f\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") "
Jul 28 13:21:29.560863 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.560717    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004a868c-e1fc-422a-b8a2-f6586e05f33f-istiod-ca-cert\") pod \"004a868c-e1fc-422a-b8a2-f6586e05f33f\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") "
Jul 28 13:21:29.560863 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.560748    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-certs\") pod \"004a868c-e1fc-422a-b8a2-f6586e05f33f\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") "
Jul 28 13:21:29.560863 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.560795    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-data\") pod \"004a868c-e1fc-422a-b8a2-f6586e05f33f\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") "
Jul 28 13:21:29.560863 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.560842    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-podinfo\") pod \"004a868c-e1fc-422a-b8a2-f6586e05f33f\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") "
Jul 28 13:21:29.561142 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.560881    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-credential-socket\") pod \"004a868c-e1fc-422a-b8a2-f6586e05f33f\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") "
Jul 28 13:21:29.561142 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.560973    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-envoy\") pod \"004a868c-e1fc-422a-b8a2-f6586e05f33f\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") "
Jul 28 13:21:29.561142 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.560976    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "004a868c-e1fc-422a-b8a2-f6586e05f33f" (UID: "004a868c-e1fc-422a-b8a2-f6586e05f33f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:21:29.561142 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.561004    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52gcv\" (UniqueName: \"kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-kube-api-access-52gcv\") pod \"004a868c-e1fc-422a-b8a2-f6586e05f33f\" (UID: \"004a868c-e1fc-422a-b8a2-f6586e05f33f\") "
Jul 28 13:21:29.561359 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.561306    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:21:29.561359 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.561311    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "004a868c-e1fc-422a-b8a2-f6586e05f33f" (UID: "004a868c-e1fc-422a-b8a2-f6586e05f33f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:21:29.561359 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.561338    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/004a868c-e1fc-422a-b8a2-f6586e05f33f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "004a868c-e1fc-422a-b8a2-f6586e05f33f" (UID: "004a868c-e1fc-422a-b8a2-f6586e05f33f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:21:29.561521 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.561476    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "004a868c-e1fc-422a-b8a2-f6586e05f33f" (UID: "004a868c-e1fc-422a-b8a2-f6586e05f33f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:21:29.561910 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.561880    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-data" (OuterVolumeSpecName: "istio-data") pod "004a868c-e1fc-422a-b8a2-f6586e05f33f" (UID: "004a868c-e1fc-422a-b8a2-f6586e05f33f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:21:29.563110 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.563080    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-token" (OuterVolumeSpecName: "istio-token") pod "004a868c-e1fc-422a-b8a2-f6586e05f33f" (UID: "004a868c-e1fc-422a-b8a2-f6586e05f33f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:21:29.563243 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.563220    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-kube-api-access-52gcv" (OuterVolumeSpecName: "kube-api-access-52gcv") pod "004a868c-e1fc-422a-b8a2-f6586e05f33f" (UID: "004a868c-e1fc-422a-b8a2-f6586e05f33f"). InnerVolumeSpecName "kube-api-access-52gcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:21:29.563416 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.563396    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "004a868c-e1fc-422a-b8a2-f6586e05f33f" (UID: "004a868c-e1fc-422a-b8a2-f6586e05f33f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:21:29.563467 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.563410    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "004a868c-e1fc-422a-b8a2-f6586e05f33f" (UID: "004a868c-e1fc-422a-b8a2-f6586e05f33f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:21:29.662235 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.662195    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-podinfo\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:21:29.662235 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.662231    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-credential-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:21:29.662235 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.662243    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-envoy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:21:29.662480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.662252    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52gcv\" (UniqueName: \"kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-kube-api-access-52gcv\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:21:29.662480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.662262    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:21:29.662480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.662270    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/004a868c-e1fc-422a-b8a2-f6586e05f33f-istiod-ca-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:21:29.662480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.662278    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-workload-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:21:29.662480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:29.662285    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/004a868c-e1fc-422a-b8a2-f6586e05f33f-istio-data\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:21:30.035288 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.035249    2567 generic.go:356] "Generic (PLEG): container finished" podID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerID="85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf" exitCode=0
Jul 28 13:21:30.035495 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.035295    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"
Jul 28 13:21:30.035495 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.035322    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" event={"ID":"004a868c-e1fc-422a-b8a2-f6586e05f33f","Type":"ContainerDied","Data":"85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf"}
Jul 28 13:21:30.035495 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.035379    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w" event={"ID":"004a868c-e1fc-422a-b8a2-f6586e05f33f","Type":"ContainerDied","Data":"535a79ade5db84d3875983a5c4d17ce4791b8f1cddd46c7dfe5fb326b20c9243"}
Jul 28 13:21:30.035495 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.035395    2567 scope.go:117] "RemoveContainer" containerID="85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf"
Jul 28 13:21:30.046030 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.046003    2567 scope.go:117] "RemoveContainer" containerID="6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32"
Jul 28 13:21:30.054586 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.054565    2567 scope.go:117] "RemoveContainer" containerID="85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf"
Jul 28 13:21:30.054892 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:21:30.054873    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf\": container with ID starting with 85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf not found: ID does not exist" containerID="85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf"
Jul 28 13:21:30.054992 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.054906    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf"} err="failed to get container status \"85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf\": rpc error: code = NotFound desc = could not find container \"85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf\": container with ID starting with 85d338a98a3072c9f27c6aa8b5aef334c53222c6b73e99555f3aa98e4a3370cf not found: ID does not exist"
Jul 28 13:21:30.054992 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.054947    2567 scope.go:117] "RemoveContainer" containerID="6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32"
Jul 28 13:21:30.055251 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:21:30.055230    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32\": container with ID starting with 6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32 not found: ID does not exist" containerID="6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32"
Jul 28 13:21:30.055296 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.055257    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32"} err="failed to get container status \"6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32\": rpc error: code = NotFound desc = could not find container \"6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32\": container with ID starting with 6caf90866cd6c0299fc1653d047cd3fee171d77fc6ef78a4023ed975cc589d32 not found: ID does not exist"
Jul 28 13:21:30.075618 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.075582    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"]
Jul 28 13:21:30.079126 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:30.079100    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-72ce9b01-openshift-default-77d95b674-rkk4w"]
Jul 28 13:21:31.501373 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:31.501342    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" path="/var/lib/kubelet/pods/004a868c-e1fc-422a-b8a2-f6586e05f33f/volumes"
Jul 28 13:21:42.018637 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:42.018560    2567 patch_prober.go:28] interesting pod/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 28 13:21:42.019190 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:42.018682    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 28 13:21:42.112523 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:42.112485    2567 generic.go:356] "Generic (PLEG): container finished" podID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerID="6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7" exitCode=0
Jul 28 13:21:42.112705 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:42.112555    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" event={"ID":"ba1375df-0b0d-42f2-b13d-92672e612a76","Type":"ContainerDied","Data":"6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7"}
Jul 28 13:21:42.113004 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:42.112984    2567 scope.go:117] "RemoveContainer" containerID="6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7"
Jul 28 13:21:42.114057 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:42.114030    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:21:42.114185 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:42.114112    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:21:42.114185 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:42.114170    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:21:43.119511 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:43.119478    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" event={"ID":"ba1375df-0b0d-42f2-b13d-92672e612a76","Type":"ContainerStarted","Data":"8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b"}
Jul 28 13:21:43.276554 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:43.276510    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:43.276791 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:43.276768    2567 patch_prober.go:28] interesting pod/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 28 13:21:43.276843 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:43.276825    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 28 13:21:44.277199 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:44.277155    2567 patch_prober.go:28] interesting pod/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 28 13:21:44.277614 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:44.277216    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 28 13:21:45.277255 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:45.277215    2567 patch_prober.go:28] interesting pod/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 28 13:21:45.277657 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:45.277275    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 28 13:21:46.276841 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:46.276798    2567 patch_prober.go:28] interesting pod/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 28 13:21:46.277062 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:46.276857    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 28 13:21:47.280475 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:47.280441    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:47.281011 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:47.280786    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:47.281424 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:47.281407    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:21:49.191246 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:49.191209    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:52.236270 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.236236    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"]
Jul 28 13:21:52.236761 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.236621    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy"
Jul 28 13:21:52.236761 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.236633    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy"
Jul 28 13:21:52.236761 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.236653    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy"
Jul 28 13:21:52.236761 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.236659    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy"
Jul 28 13:21:52.236761 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.236710    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy"
Jul 28 13:21:52.236761 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.236719    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="004a868c-e1fc-422a-b8a2-f6586e05f33f" containerName="istio-proxy"
Jul 28 13:21:52.239656 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.239639    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"
Jul 28 13:21:52.242044 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.242019    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6qfh\""
Jul 28 13:21:52.242188 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.242049    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 13:21:52.246890 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.246861    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"]
Jul 28 13:21:52.383741 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.383699    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb\" (UID: \"28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"
Jul 28 13:21:52.484599 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.484561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb\" (UID: \"28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"
Jul 28 13:21:52.485237 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.485215    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb\" (UID: \"28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"
Jul 28 13:21:52.552189 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.552153    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"
Jul 28 13:21:52.690370 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:52.690315    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"]
Jul 28 13:21:52.692615 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:21:52.692575    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28aab86d_478a_45e1_8dcd_b5cbc1ef1aa3.slice/crio-d02a9bf23272a01b7ed44050d2e85042e0e1880715605f84ef6612ef45e49c98 WatchSource:0}: Error finding container d02a9bf23272a01b7ed44050d2e85042e0e1880715605f84ef6612ef45e49c98: Status 404 returned error can't find the container with id d02a9bf23272a01b7ed44050d2e85042e0e1880715605f84ef6612ef45e49c98
Jul 28 13:21:53.187986 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:53.187952    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb" event={"ID":"28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3","Type":"ContainerStarted","Data":"a6e8356c85779d79fc9dedc464dd5144c53d679f29a80f7041e81fc8c43fe992"}
Jul 28 13:21:53.188166 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:53.188016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb" event={"ID":"28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3","Type":"ContainerStarted","Data":"d02a9bf23272a01b7ed44050d2e85042e0e1880715605f84ef6612ef45e49c98"}
Jul 28 13:21:53.204278 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:53.204158    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb" podStartSLOduration=1.204137818 podStartE2EDuration="1.204137818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:21:53.20372586 +0000 UTC m=+1840.133009778" watchObservedRunningTime="2026-07-28 13:21:53.204137818 +0000 UTC m=+1840.133421736"
Jul 28 13:21:54.195339 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:54.195308    2567 generic.go:356] "Generic (PLEG): container finished" podID="28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3" containerID="a6e8356c85779d79fc9dedc464dd5144c53d679f29a80f7041e81fc8c43fe992" exitCode=0
Jul 28 13:21:54.195760 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:54.195404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb" event={"ID":"28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3","Type":"ContainerDied","Data":"a6e8356c85779d79fc9dedc464dd5144c53d679f29a80f7041e81fc8c43fe992"}
Jul 28 13:21:55.344113 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:55.344086    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"
Jul 28 13:21:55.411462 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:55.411425    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3-maas-api-service-ca\") pod \"28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3\" (UID: \"28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3\") "
Jul 28 13:21:55.411835 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:55.411815    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3" (UID: "28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:21:55.512118 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:55.512092    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3-maas-api-service-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:21:56.208466 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:56.208434    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"
Jul 28 13:21:56.208646 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:56.208471    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb" event={"ID":"28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3","Type":"ContainerDied","Data":"d02a9bf23272a01b7ed44050d2e85042e0e1880715605f84ef6612ef45e49c98"}
Jul 28 13:21:56.208646 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:56.208519    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d02a9bf23272a01b7ed44050d2e85042e0e1880715605f84ef6612ef45e49c98"
Jul 28 13:21:58.079965 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:58.079913    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:58.159055 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:58.159025    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:58.224798 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:58.224764    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:58.270039 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:58.270009    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"]
Jul 28 13:21:58.272301 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:58.272280    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0c0ab0cc-pxxwb"]
Jul 28 13:21:58.291860 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:58.291815    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:58.398402 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:58.398312    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"]
Jul 28 13:21:58.398558 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:58.398520    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy" containerID="cri-o://8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b" gracePeriod=30
Jul 28 13:21:58.430360 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:58.430327    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:58.663146 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:58.663047    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:59.171540 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:59.171507    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:59.265193 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:59.265158    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:59.365744 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:59.365710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:21:59.502904 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:21:59.502802    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3" path="/var/lib/kubelet/pods/28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3/volumes"
Jul 28 13:22:00.797248 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:00.797213    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:22:02.283295 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:02.283251    2567 patch_prober.go:28] interesting pod/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 28 13:22:02.283682 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:02.283317    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 13:22:03.668445 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.668368    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:22:03.787539 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.787498    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1375df-0b0d-42f2-b13d-92672e612a76-istiod-ca-cert\") pod \"ba1375df-0b0d-42f2-b13d-92672e612a76\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") "
Jul 28 13:22:03.787741 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.787559    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-socket\") pod \"ba1375df-0b0d-42f2-b13d-92672e612a76\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") "
Jul 28 13:22:03.787741 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.787580    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-credential-socket\") pod \"ba1375df-0b0d-42f2-b13d-92672e612a76\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") "
Jul 28 13:22:03.787741 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.787622    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-podinfo\") pod \"ba1375df-0b0d-42f2-b13d-92672e612a76\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") "
Jul 28 13:22:03.787741 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.787648    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pglgl\" (UniqueName: \"kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-kube-api-access-pglgl\") pod \"ba1375df-0b0d-42f2-b13d-92672e612a76\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") "
Jul 28 13:22:03.787741 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.787668    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-token\") pod \"ba1375df-0b0d-42f2-b13d-92672e612a76\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") "
Jul 28 13:22:03.787741 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.787699    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-data\") pod \"ba1375df-0b0d-42f2-b13d-92672e612a76\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") "
Jul 28 13:22:03.788104 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.787755    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-envoy\") pod \"ba1375df-0b0d-42f2-b13d-92672e612a76\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") "
Jul 28 13:22:03.788104 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.787793    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-certs\") pod \"ba1375df-0b0d-42f2-b13d-92672e612a76\" (UID: \"ba1375df-0b0d-42f2-b13d-92672e612a76\") "
Jul 28 13:22:03.788104 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.787900    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba1375df-0b0d-42f2-b13d-92672e612a76" (UID: "ba1375df-0b0d-42f2-b13d-92672e612a76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:22:03.788104 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.788006    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba1375df-0b0d-42f2-b13d-92672e612a76" (UID: "ba1375df-0b0d-42f2-b13d-92672e612a76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:22:03.788104 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.788051    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1375df-0b0d-42f2-b13d-92672e612a76-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba1375df-0b0d-42f2-b13d-92672e612a76" (UID: "ba1375df-0b0d-42f2-b13d-92672e612a76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:22:03.788354 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.788152    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:22:03.788354 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.788171    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-credential-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:22:03.788354 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.788278    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba1375df-0b0d-42f2-b13d-92672e612a76" (UID: "ba1375df-0b0d-42f2-b13d-92672e612a76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:22:03.788959 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.788913    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba1375df-0b0d-42f2-b13d-92672e612a76" (UID: "ba1375df-0b0d-42f2-b13d-92672e612a76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:22:03.789972 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.789914    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba1375df-0b0d-42f2-b13d-92672e612a76" (UID: "ba1375df-0b0d-42f2-b13d-92672e612a76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:22:03.790090 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.789944    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-kube-api-access-pglgl" (OuterVolumeSpecName: "kube-api-access-pglgl") pod "ba1375df-0b0d-42f2-b13d-92672e612a76" (UID: "ba1375df-0b0d-42f2-b13d-92672e612a76"). InnerVolumeSpecName "kube-api-access-pglgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:22:03.790090 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.790006    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba1375df-0b0d-42f2-b13d-92672e612a76" (UID: "ba1375df-0b0d-42f2-b13d-92672e612a76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:22:03.790090 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.790046    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba1375df-0b0d-42f2-b13d-92672e612a76" (UID: "ba1375df-0b0d-42f2-b13d-92672e612a76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:22:03.889294 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.889251    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-envoy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:22:03.889294 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.889285    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-workload-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:22:03.889294 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.889295    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba1375df-0b0d-42f2-b13d-92672e612a76-istiod-ca-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:22:03.889294 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.889304    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-podinfo\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:22:03.889660 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.889312    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pglgl\" (UniqueName: \"kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-kube-api-access-pglgl\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:22:03.889660 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.889322    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:22:03.889660 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:03.889330    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba1375df-0b0d-42f2-b13d-92672e612a76-istio-data\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:22:04.259303 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.259267    2567 generic.go:356] "Generic (PLEG): container finished" podID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerID="8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b" exitCode=0
Jul 28 13:22:04.259514 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.259321    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"
Jul 28 13:22:04.259514 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.259351    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" event={"ID":"ba1375df-0b0d-42f2-b13d-92672e612a76","Type":"ContainerDied","Data":"8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b"}
Jul 28 13:22:04.259514 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.259418    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr" event={"ID":"ba1375df-0b0d-42f2-b13d-92672e612a76","Type":"ContainerDied","Data":"f2bc8794676197c77a1b628dc62d7d8f8212e615c859a2997b466d2f198a3aad"}
Jul 28 13:22:04.259514 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.259449    2567 scope.go:117] "RemoveContainer" containerID="8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b"
Jul 28 13:22:04.269548 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.269512    2567 scope.go:117] "RemoveContainer" containerID="6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7"
Jul 28 13:22:04.278612 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.278586    2567 scope.go:117] "RemoveContainer" containerID="8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b"
Jul 28 13:22:04.278945 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:22:04.278905    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b\": container with ID starting with 8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b not found: ID does not exist" containerID="8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b"
Jul 28 13:22:04.279044 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.278962    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b"} err="failed to get container status \"8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b\": rpc error: code = NotFound desc = could not find container \"8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b\": container with ID starting with 8efb80ace9c4f7593abc550c43d708ddccf8a66a4a1f9bd9a05a6c018410789b not found: ID does not exist"
Jul 28 13:22:04.279120 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.279051    2567 scope.go:117] "RemoveContainer" containerID="6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7"
Jul 28 13:22:04.279330 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:22:04.279299    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7\": container with ID starting with 6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7 not found: ID does not exist" containerID="6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7"
Jul 28 13:22:04.279391 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.279339    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7"} err="failed to get container status \"6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7\": rpc error: code = NotFound desc = could not find container \"6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7\": container with ID starting with 6b974eef3f6a4f2f17d5284c24e9f3f029db9db9f50926fc826c3388bcdfbdd7 not found: ID does not exist"
Jul 28 13:22:04.284716 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.284689    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"]
Jul 28 13:22:04.290957 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:04.290915    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0c0ab0cc-openshift-default-68f4b76c6-t6vlr"]
Jul 28 13:22:05.500868 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:05.500837    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" path="/var/lib/kubelet/pods/ba1375df-0b0d-42f2-b13d-92672e612a76/volumes"
Jul 28 13:22:07.550067 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:07.550038    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:22:07.662602 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:07.662553    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:22:07.750845 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:07.750813    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:22:07.850362 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:07.850255    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:22:08.275531 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:08.275489    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:22:34.249089 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:34.249053    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:22:40.874606 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:40.874447    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:22:42.877803 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:42.877762    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:22:56.981542 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:22:56.981511    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:02.904835 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:02.904797    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:03.008056 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:03.008025    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:03.106424 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:03.106387    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:09.751124 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:09.751090    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:09.810269 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:09.810234    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:13.631943 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:13.631886    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:14.455821 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:14.455784    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:20.942955 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:20.942835    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:21.049943 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:21.049879    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:21.140518 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:21.140478    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:21.270871 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:21.270839    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:27.284667 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:27.284630    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:27.384662 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:27.384613    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:27.485237 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:27.485184    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:29.261938 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:29.261889    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:35.770072 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:35.770040    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:35.874766 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:35.874714    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:36.493861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:36.493817    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:43.012572 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.012532    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:43.076361 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.076329    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:43.269359 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.269327    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:43.547724 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.547638    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"]
Jul 28 13:23:43.548137 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.548117    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy"
Jul 28 13:23:43.548137 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.548136    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy"
Jul 28 13:23:43.548334 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.548154    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3" containerName="revoke-keys"
Jul 28 13:23:43.548334 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.548165    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3" containerName="revoke-keys"
Jul 28 13:23:43.548334 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.548173    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy"
Jul 28 13:23:43.548334 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.548179    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy"
Jul 28 13:23:43.548334 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.548240    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="28aab86d-478a-45e1-8dcd-b5cbc1ef1aa3" containerName="revoke-keys"
Jul 28 13:23:43.548334 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.548249    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy"
Jul 28 13:23:43.548334 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.548257    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1375df-0b0d-42f2-b13d-92672e612a76" containerName="istio-proxy"
Jul 28 13:23:43.551382 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.551363    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.553960 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.553914    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a757517a-openshift-default-dockercfg-gk7rn\""
Jul 28 13:23:43.571241 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.571213    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"]
Jul 28 13:23:43.585160 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.585073    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:43.696974 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.696904    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbq55\" (UniqueName: \"kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-kube-api-access-wbq55\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.696974 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.696970    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b665ff8-b231-4415-891c-3ac203bfdb0b-istiod-ca-cert\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.697257 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.697098    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-socket\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.697257 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.697137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-certs\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.697257 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.697188    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-podinfo\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.697257 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.697237    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-token\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.697433 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.697281    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-data\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.697433 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.697333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-credential-socket\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.697433 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.697358    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-envoy\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.720156 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.720119    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:43.798526 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.798429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbq55\" (UniqueName: \"kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-kube-api-access-wbq55\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.798526 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.798470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b665ff8-b231-4415-891c-3ac203bfdb0b-istiod-ca-cert\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.798767 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.798660    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-socket\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.798767 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.798703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-certs\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.798767 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.798755    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-podinfo\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.798963 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.798801    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-token\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.798963 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.798862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-data\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.798963 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.798906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-credential-socket\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.799121 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.798966    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-envoy\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.799121 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.799040    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-socket\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.799238 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.799123    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-certs\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.799238 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.799161    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b665ff8-b231-4415-891c-3ac203bfdb0b-istiod-ca-cert\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.799352 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.799279    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-credential-socket\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.799478 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.799449    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-data\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.801200 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.801182    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-envoy\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.801884 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.801860    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-podinfo\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.806509 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.806484    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-token\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.806617 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.806540    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbq55\" (UniqueName: \"kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-kube-api-access-wbq55\") pod \"e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") " pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:43.862029 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:43.861994    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:44.019329 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:44.019299    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"]
Jul 28 13:23:44.021106 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:23:44.021079    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b665ff8_b231_4415_891c_3ac203bfdb0b.slice/crio-7030d0ee2eea282c7e824b3773bf147a0cfb0dcf51cea01db4a1e9a59f5972ec WatchSource:0}: Error finding container 7030d0ee2eea282c7e824b3773bf147a0cfb0dcf51cea01db4a1e9a59f5972ec: Status 404 returned error can't find the container with id 7030d0ee2eea282c7e824b3773bf147a0cfb0dcf51cea01db4a1e9a59f5972ec
Jul 28 13:23:44.023312 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:44.023277    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:23:44.023429 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:44.023363    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:23:44.023429 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:44.023413    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:23:44.812151 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:44.812121    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" event={"ID":"3b665ff8-b231-4415-891c-3ac203bfdb0b","Type":"ContainerStarted","Data":"76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e"}
Jul 28 13:23:44.812360 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:44.812178    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" event={"ID":"3b665ff8-b231-4415-891c-3ac203bfdb0b","Type":"ContainerStarted","Data":"7030d0ee2eea282c7e824b3773bf147a0cfb0dcf51cea01db4a1e9a59f5972ec"}
Jul 28 13:23:44.836710 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:44.836631    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" podStartSLOduration=1.836609892 podStartE2EDuration="1.836609892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:23:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:23:44.833503001 +0000 UTC m=+1951.762786919" watchObservedRunningTime="2026-07-28 13:23:44.836609892 +0000 UTC m=+1951.765893810"
Jul 28 13:23:44.863036 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:44.862974    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:45.867430 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:45.867400    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:46.806003 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:46.805968    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:46.824074 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:46.824031    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:46.825356 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:46.825332    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:23:46.895562 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:46.895530    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:46.972200 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:46.972157    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:47.072213 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.072124    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:47.596172 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.596139    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:47.700609 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.700557    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:23:47.784293 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.784259    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"]
Jul 28 13:23:47.787479 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.787446    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:23:47.790019 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.789996    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a757517a-dockercfg-v6v2n\""
Jul 28 13:23:47.790183 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.790021    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a757517a\""
Jul 28 13:23:47.799050 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.799021    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"]
Jul 28 13:23:47.837948 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.837513    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c06cf52c-817e-4e81-bc9e-436c1eb16980-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9\" (UID: \"c06cf52c-817e-4e81-bc9e-436c1eb16980\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:23:47.837948 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.837623    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsgl6\" (UniqueName: \"kubernetes.io/projected/c06cf52c-817e-4e81-bc9e-436c1eb16980-kube-api-access-fsgl6\") pod \"payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9\" (UID: \"c06cf52c-817e-4e81-bc9e-436c1eb16980\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:23:47.938499 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.938396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c06cf52c-817e-4e81-bc9e-436c1eb16980-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9\" (UID: \"c06cf52c-817e-4e81-bc9e-436c1eb16980\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:23:47.938499 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.938495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsgl6\" (UniqueName: \"kubernetes.io/projected/c06cf52c-817e-4e81-bc9e-436c1eb16980-kube-api-access-fsgl6\") pod \"payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9\" (UID: \"c06cf52c-817e-4e81-bc9e-436c1eb16980\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:23:47.939218 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.939198    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c06cf52c-817e-4e81-bc9e-436c1eb16980-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9\" (UID: \"c06cf52c-817e-4e81-bc9e-436c1eb16980\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:23:47.951566 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:47.951535    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsgl6\" (UniqueName: \"kubernetes.io/projected/c06cf52c-817e-4e81-bc9e-436c1eb16980-kube-api-access-fsgl6\") pod \"payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9\" (UID: \"c06cf52c-817e-4e81-bc9e-436c1eb16980\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:23:48.100430 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:48.100393    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:23:48.264790 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:48.264766    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"]
Jul 28 13:23:48.267256 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:23:48.267212    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06cf52c_817e_4e81_bc9e_436c1eb16980.slice/crio-931dbeb00b9a4832bb902f0a8574b15642c215e1068db4481d9ba8172ce9b7cf WatchSource:0}: Error finding container 931dbeb00b9a4832bb902f0a8574b15642c215e1068db4481d9ba8172ce9b7cf: Status 404 returned error can't find the container with id 931dbeb00b9a4832bb902f0a8574b15642c215e1068db4481d9ba8172ce9b7cf
Jul 28 13:23:48.839170 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:48.839127    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9" event={"ID":"c06cf52c-817e-4e81-bc9e-436c1eb16980","Type":"ContainerStarted","Data":"3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032"}
Jul 28 13:23:48.839379 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:48.839196    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9" event={"ID":"c06cf52c-817e-4e81-bc9e-436c1eb16980","Type":"ContainerStarted","Data":"931dbeb00b9a4832bb902f0a8574b15642c215e1068db4481d9ba8172ce9b7cf"}
Jul 28 13:23:48.839451 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:48.839421    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:23:48.867559 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:48.867482    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9" podStartSLOduration=1.867460086 podStartE2EDuration="1.867460086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:23:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:23:48.86463656 +0000 UTC m=+1955.793920478" watchObservedRunningTime="2026-07-28 13:23:48.867460086 +0000 UTC m=+1955.796744010"
Jul 28 13:23:59.848179 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:23:59.848148    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:24:00.908384 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:00.908304    2567 generic.go:356] "Generic (PLEG): container finished" podID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerID="76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e" exitCode=0
Jul 28 13:24:00.908813 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:00.908379    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" event={"ID":"3b665ff8-b231-4415-891c-3ac203bfdb0b","Type":"ContainerDied","Data":"76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e"}
Jul 28 13:24:00.908863 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:00.908846    2567 scope.go:117] "RemoveContainer" containerID="76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e"
Jul 28 13:24:00.909848 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:00.909818    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:24:00.909966 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:00.909887    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:24:00.909966 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:00.909937    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:24:01.824345 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:01.824305    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:24:01.919132 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:01.919099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" event={"ID":"3b665ff8-b231-4415-891c-3ac203bfdb0b","Type":"ContainerStarted","Data":"5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0"}
Jul 28 13:24:02.862459 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:02.862414    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:24:02.863577 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:02.863546    2567 patch_prober.go:28] interesting pod/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 13:24:02.863713 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:02.863613    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 13:24:03.862687 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:03.862652    2567 patch_prober.go:28] interesting pod/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 13:24:03.863147 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:03.862708    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 13:24:04.863179 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:04.863144    2567 patch_prober.go:28] interesting pod/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 13:24:04.863635 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:04.863201    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 13:24:05.863127 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:05.863089    2567 patch_prober.go:28] interesting pod/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 28 13:24:05.863377 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:05.863153    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 28 13:24:06.866721 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:06.866691    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:24:06.867256 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:06.867031    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:24:06.867823 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:06.867809    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:24:11.822743 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:11.822708    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:12.587139 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:12.587109    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:12.717755 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:12.717723    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:13.083638 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:13.083604    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:19.118241 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:19.118210    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:19.231214 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:19.231184    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:19.331758 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:19.331727    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:29.974988 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:29.974949    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:30.004606 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.004560    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"]
Jul 28 13:24:30.004902 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.004846    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9" podUID="c06cf52c-817e-4e81-bc9e-436c1eb16980" containerName="payload-pre-processing" containerID="cri-o://3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032" gracePeriod=30
Jul 28 13:24:30.074088 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.074055    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:30.145383 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.145348    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:30.203076 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.202977    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:30.273364 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.273334    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:24:30.435698 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.435659    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsgl6\" (UniqueName: \"kubernetes.io/projected/c06cf52c-817e-4e81-bc9e-436c1eb16980-kube-api-access-fsgl6\") pod \"c06cf52c-817e-4e81-bc9e-436c1eb16980\" (UID: \"c06cf52c-817e-4e81-bc9e-436c1eb16980\") "
Jul 28 13:24:30.435874 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.435819    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c06cf52c-817e-4e81-bc9e-436c1eb16980-plugins-config-volume\") pod \"c06cf52c-817e-4e81-bc9e-436c1eb16980\" (UID: \"c06cf52c-817e-4e81-bc9e-436c1eb16980\") "
Jul 28 13:24:30.436198 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.436173    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c06cf52c-817e-4e81-bc9e-436c1eb16980-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c06cf52c-817e-4e81-bc9e-436c1eb16980" (UID: "c06cf52c-817e-4e81-bc9e-436c1eb16980"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:24:30.437760 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.437734    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c06cf52c-817e-4e81-bc9e-436c1eb16980-kube-api-access-fsgl6" (OuterVolumeSpecName: "kube-api-access-fsgl6") pod "c06cf52c-817e-4e81-bc9e-436c1eb16980" (UID: "c06cf52c-817e-4e81-bc9e-436c1eb16980"). InnerVolumeSpecName "kube-api-access-fsgl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:24:30.537428 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.537393    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c06cf52c-817e-4e81-bc9e-436c1eb16980-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:30.537428 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.537421    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsgl6\" (UniqueName: \"kubernetes.io/projected/c06cf52c-817e-4e81-bc9e-436c1eb16980-kube-api-access-fsgl6\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:30.574788 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:30.574746    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:31.082636 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:31.082601    2567 generic.go:356] "Generic (PLEG): container finished" podID="c06cf52c-817e-4e81-bc9e-436c1eb16980" containerID="3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032" exitCode=0
Jul 28 13:24:31.083087 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:31.082649    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"
Jul 28 13:24:31.083087 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:31.082681    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9" event={"ID":"c06cf52c-817e-4e81-bc9e-436c1eb16980","Type":"ContainerDied","Data":"3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032"}
Jul 28 13:24:31.083087 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:31.082746    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9" event={"ID":"c06cf52c-817e-4e81-bc9e-436c1eb16980","Type":"ContainerDied","Data":"931dbeb00b9a4832bb902f0a8574b15642c215e1068db4481d9ba8172ce9b7cf"}
Jul 28 13:24:31.083087 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:31.082770    2567 scope.go:117] "RemoveContainer" containerID="3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032"
Jul 28 13:24:31.092213 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:31.092194    2567 scope.go:117] "RemoveContainer" containerID="3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032"
Jul 28 13:24:31.092506 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:24:31.092488    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032\": container with ID starting with 3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032 not found: ID does not exist" containerID="3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032"
Jul 28 13:24:31.092557 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:31.092515    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032"} err="failed to get container status \"3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032\": rpc error: code = NotFound desc = could not find container \"3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032\": container with ID starting with 3286366735f59665502e35c8b3a73b4d40055e05c50775f2b6f6e6ad166e8032 not found: ID does not exist"
Jul 28 13:24:31.105221 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:31.105190    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"]
Jul 28 13:24:31.109339 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:31.109313    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a757517a-66fbd7bcd8-vxrz9"]
Jul 28 13:24:31.500693 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:31.500606    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c06cf52c-817e-4e81-bc9e-436c1eb16980" path="/var/lib/kubelet/pods/c06cf52c-817e-4e81-bc9e-436c1eb16980/volumes"
Jul 28 13:24:36.441340 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:36.441293    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:36.546220 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:36.546183    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:36.785682 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:36.785652    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"]
Jul 28 13:24:36.785869 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:36.785849    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy" containerID="cri-o://5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0" gracePeriod=30
Jul 28 13:24:36.831428 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:36.831390    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:36.869332 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:36.869240    2567 patch_prober.go:28] interesting pod/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 13:24:36.869332 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:36.869311    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 13:24:37.069555 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:37.069406    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:37.224477 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:37.224441    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:37.319142 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:37.319096    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:37.490778 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:37.490646    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:42.052525 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.052458    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:24:42.124212 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124164    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-credential-socket\") pod \"3b665ff8-b231-4415-891c-3ac203bfdb0b\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") "
Jul 28 13:24:42.124406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124232    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-certs\") pod \"3b665ff8-b231-4415-891c-3ac203bfdb0b\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") "
Jul 28 13:24:42.124406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124249    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-envoy\") pod \"3b665ff8-b231-4415-891c-3ac203bfdb0b\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") "
Jul 28 13:24:42.124406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124271    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b665ff8-b231-4415-891c-3ac203bfdb0b-istiod-ca-cert\") pod \"3b665ff8-b231-4415-891c-3ac203bfdb0b\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") "
Jul 28 13:24:42.124406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124296    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-podinfo\") pod \"3b665ff8-b231-4415-891c-3ac203bfdb0b\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") "
Jul 28 13:24:42.124406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124323    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-token\") pod \"3b665ff8-b231-4415-891c-3ac203bfdb0b\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") "
Jul 28 13:24:42.124406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124358    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbq55\" (UniqueName: \"kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-kube-api-access-wbq55\") pod \"3b665ff8-b231-4415-891c-3ac203bfdb0b\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") "
Jul 28 13:24:42.124406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124390    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-data\") pod \"3b665ff8-b231-4415-891c-3ac203bfdb0b\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") "
Jul 28 13:24:42.124785 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124447    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-socket\") pod \"3b665ff8-b231-4415-891c-3ac203bfdb0b\" (UID: \"3b665ff8-b231-4415-891c-3ac203bfdb0b\") "
Jul 28 13:24:42.124785 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124488    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b665ff8-b231-4415-891c-3ac203bfdb0b" (UID: "3b665ff8-b231-4415-891c-3ac203bfdb0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:24:42.124785 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124568    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b665ff8-b231-4415-891c-3ac203bfdb0b" (UID: "3b665ff8-b231-4415-891c-3ac203bfdb0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:24:42.124785 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124767    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b665ff8-b231-4415-891c-3ac203bfdb0b" (UID: "3b665ff8-b231-4415-891c-3ac203bfdb0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:24:42.125043 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124792    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-credential-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:42.125043 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124811    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:42.125043 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.124987    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b665ff8-b231-4415-891c-3ac203bfdb0b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b665ff8-b231-4415-891c-3ac203bfdb0b" (UID: "3b665ff8-b231-4415-891c-3ac203bfdb0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:24:42.125451 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.125423    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b665ff8-b231-4415-891c-3ac203bfdb0b" (UID: "3b665ff8-b231-4415-891c-3ac203bfdb0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:24:42.126563 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.126529    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b665ff8-b231-4415-891c-3ac203bfdb0b" (UID: "3b665ff8-b231-4415-891c-3ac203bfdb0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:24:42.126687 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.126585    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b665ff8-b231-4415-891c-3ac203bfdb0b" (UID: "3b665ff8-b231-4415-891c-3ac203bfdb0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:24:42.126687 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.126611    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-kube-api-access-wbq55" (OuterVolumeSpecName: "kube-api-access-wbq55") pod "3b665ff8-b231-4415-891c-3ac203bfdb0b" (UID: "3b665ff8-b231-4415-891c-3ac203bfdb0b"). InnerVolumeSpecName "kube-api-access-wbq55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:24:42.126687 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.126669    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b665ff8-b231-4415-891c-3ac203bfdb0b" (UID: "3b665ff8-b231-4415-891c-3ac203bfdb0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:24:42.148228 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.148195    2567 generic.go:356] "Generic (PLEG): container finished" podID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerID="5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0" exitCode=0
Jul 28 13:24:42.148410 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.148243    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"
Jul 28 13:24:42.148410 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.148273    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" event={"ID":"3b665ff8-b231-4415-891c-3ac203bfdb0b","Type":"ContainerDied","Data":"5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0"}
Jul 28 13:24:42.148410 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.148325    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv" event={"ID":"3b665ff8-b231-4415-891c-3ac203bfdb0b","Type":"ContainerDied","Data":"7030d0ee2eea282c7e824b3773bf147a0cfb0dcf51cea01db4a1e9a59f5972ec"}
Jul 28 13:24:42.148410 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.148349    2567 scope.go:117] "RemoveContainer" containerID="5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0"
Jul 28 13:24:42.158336 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.158319    2567 scope.go:117] "RemoveContainer" containerID="76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e"
Jul 28 13:24:42.167244 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.167219    2567 scope.go:117] "RemoveContainer" containerID="5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0"
Jul 28 13:24:42.167546 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:24:42.167526    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0\": container with ID starting with 5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0 not found: ID does not exist" containerID="5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0"
Jul 28 13:24:42.167610 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.167558    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0"} err="failed to get container status \"5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0\": rpc error: code = NotFound desc = could not find container \"5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0\": container with ID starting with 5d0ccc8d8efe2f6f970881c6435f30b6b76e8f98e2f11c5975b8236c0929dfa0 not found: ID does not exist"
Jul 28 13:24:42.167610 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.167578    2567 scope.go:117] "RemoveContainer" containerID="76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e"
Jul 28 13:24:42.167859 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:24:42.167844    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e\": container with ID starting with 76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e not found: ID does not exist" containerID="76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e"
Jul 28 13:24:42.167954 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.167865    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e"} err="failed to get container status \"76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e\": rpc error: code = NotFound desc = could not find container \"76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e\": container with ID starting with 76a217956068beac124aefb3094a0ea9c9b01678cbf35c684db34b1395d1519e not found: ID does not exist"
Jul 28 13:24:42.169807 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.169786    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"]
Jul 28 13:24:42.173271 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.173249    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a757517a-openshift-default-5cb8c9d5c6-d2hgv"]
Jul 28 13:24:42.225466 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.225432    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-envoy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:42.225466 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.225465    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b665ff8-b231-4415-891c-3ac203bfdb0b-istiod-ca-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:42.225466 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.225479    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-podinfo\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:42.225717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.225492    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:42.225717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.225506    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbq55\" (UniqueName: \"kubernetes.io/projected/3b665ff8-b231-4415-891c-3ac203bfdb0b-kube-api-access-wbq55\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:42.225717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.225518    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-istio-data\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:42.225717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:42.225531    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b665ff8-b231-4415-891c-3ac203bfdb0b-workload-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:24:43.446043 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:43.446008    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:43.501166 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:43.501123    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" path="/var/lib/kubelet/pods/3b665ff8-b231-4415-891c-3ac203bfdb0b/volumes"
Jul 28 13:24:43.507392 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:43.507367    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:43.589397 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:43.589359    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:43.681534 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:43.681502    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:43.836804 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:43.836768    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:49.794315 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:49.794281    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:49.864165 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:49.864132    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:57.174447 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.174408    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:57.485064 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.484974    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"]
Jul 28 13:24:57.485343 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.485330    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c06cf52c-817e-4e81-bc9e-436c1eb16980" containerName="payload-pre-processing"
Jul 28 13:24:57.485387 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.485345    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c06cf52c-817e-4e81-bc9e-436c1eb16980" containerName="payload-pre-processing"
Jul 28 13:24:57.485387 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.485355    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy"
Jul 28 13:24:57.485387 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.485361    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy"
Jul 28 13:24:57.485387 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.485375    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy"
Jul 28 13:24:57.485387 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.485380    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy"
Jul 28 13:24:57.485540 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.485439    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy"
Jul 28 13:24:57.485540 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.485447    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c06cf52c-817e-4e81-bc9e-436c1eb16980" containerName="payload-pre-processing"
Jul 28 13:24:57.488681 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.488660    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.491426 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.491402    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-11cb60ac-openshift-default-dockercfg-zj9lk\""
Jul 28 13:24:57.503113 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.503084    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"]
Jul 28 13:24:57.511648 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.511626    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:57.558824 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.558778    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-credential-socket\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.558824 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.558825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-podinfo\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.559090 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.558842    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-token\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.559090 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.559000    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkczs\" (UniqueName: \"kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-kube-api-access-gkczs\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.559090 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.559030    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-certs\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.559260 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.559175    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098f7e28-bc11-47fc-8c66-c5886ec295d6-istiod-ca-cert\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.559260 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.559210    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-data\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.559260 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.559254    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-envoy\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.559406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.559279    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-socket\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.660316 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-envoy\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.660316 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-socket\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.660579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-credential-socket\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.660579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660422    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-podinfo\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.660579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660447    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-token\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.660579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkczs\" (UniqueName: \"kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-kube-api-access-gkczs\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.660579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660530    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-certs\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.660579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098f7e28-bc11-47fc-8c66-c5886ec295d6-istiod-ca-cert\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.661025 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660607    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-data\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.661025 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660820    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-credential-socket\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.661025 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.660988    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-certs\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.661195 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.661083    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-socket\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.661254 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.661192    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-data\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.661418 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.661397    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098f7e28-bc11-47fc-8c66-c5886ec295d6-istiod-ca-cert\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.662958 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.662939    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-podinfo\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.663101 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.663079    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-envoy\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.668882 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.668856    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-token\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.669025 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.668952    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkczs\" (UniqueName: \"kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-kube-api-access-gkczs\") pod \"e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") " pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.801108 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.801068    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:57.924429 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.924394    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:24:57.945186 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.945162    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"]
Jul 28 13:24:57.947459 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:24:57.947430    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098f7e28_bc11_47fc_8c66_c5886ec295d6.slice/crio-8070dc5a9ff332d6f3c465e2db84db7a1636dd6dace89600cf4be2d252db8339 WatchSource:0}: Error finding container 8070dc5a9ff332d6f3c465e2db84db7a1636dd6dace89600cf4be2d252db8339: Status 404 returned error can't find the container with id 8070dc5a9ff332d6f3c465e2db84db7a1636dd6dace89600cf4be2d252db8339
Jul 28 13:24:57.949788 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.949754    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:24:57.949861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.949826    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:24:57.949861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:57.949855    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:24:58.237579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:58.237474    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" event={"ID":"098f7e28-bc11-47fc-8c66-c5886ec295d6","Type":"ContainerStarted","Data":"0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5"}
Jul 28 13:24:58.237579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:58.237556    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" event={"ID":"098f7e28-bc11-47fc-8c66-c5886ec295d6","Type":"ContainerStarted","Data":"8070dc5a9ff332d6f3c465e2db84db7a1636dd6dace89600cf4be2d252db8339"}
Jul 28 13:24:58.259128 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:58.259067    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" podStartSLOduration=1.259047072 podStartE2EDuration="1.259047072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:24:58.257662751 +0000 UTC m=+2025.186946671" watchObservedRunningTime="2026-07-28 13:24:58.259047072 +0000 UTC m=+2025.188330988"
Jul 28 13:24:58.801570 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:58.801533    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:24:59.806991 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:24:59.806952    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:25:00.251980 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:00.251864    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:25:00.252863 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:00.252839    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:25:00.295756 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:00.295710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:00.374696 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:00.374656    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:00.475624 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:00.475592    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:00.684167 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:00.684123    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:01.159411 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.159374    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:01.253039 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.253005    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:01.258020 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.257993    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"]
Jul 28 13:25:01.258425 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.258412    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b665ff8-b231-4415-891c-3ac203bfdb0b" containerName="istio-proxy"
Jul 28 13:25:01.261517 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.261499    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:25:01.263880 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.263850    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-11cb60ac\""
Jul 28 13:25:01.264046 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.263850    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-11cb60ac-dockercfg-v2sfg\""
Jul 28 13:25:01.271901 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.271875    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"]
Jul 28 13:25:01.395537 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.395495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdr87\" (UniqueName: \"kubernetes.io/projected/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-kube-api-access-wdr87\") pod \"payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch\" (UID: \"8ca1ae84-cc63-4d53-a19c-58f048aea2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:25:01.395717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.395558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch\" (UID: \"8ca1ae84-cc63-4d53-a19c-58f048aea2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:25:01.496130 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.496030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch\" (UID: \"8ca1ae84-cc63-4d53-a19c-58f048aea2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:25:01.496289 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.496170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdr87\" (UniqueName: \"kubernetes.io/projected/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-kube-api-access-wdr87\") pod \"payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch\" (UID: \"8ca1ae84-cc63-4d53-a19c-58f048aea2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:25:01.496772 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.496752    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch\" (UID: \"8ca1ae84-cc63-4d53-a19c-58f048aea2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:25:01.505506 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.505472    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdr87\" (UniqueName: \"kubernetes.io/projected/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-kube-api-access-wdr87\") pod \"payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch\" (UID: \"8ca1ae84-cc63-4d53-a19c-58f048aea2f6\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:25:01.574174 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.574114    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:25:01.716986 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:01.716956    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"]
Jul 28 13:25:01.718365 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:25:01.718337    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca1ae84_cc63_4d53_a19c_58f048aea2f6.slice/crio-9f83c6318f5ee8649f6b8149fb7996c4166c4d9b0f42ab4d362694e0fc03c27d WatchSource:0}: Error finding container 9f83c6318f5ee8649f6b8149fb7996c4166c4d9b0f42ab4d362694e0fc03c27d: Status 404 returned error can't find the container with id 9f83c6318f5ee8649f6b8149fb7996c4166c4d9b0f42ab4d362694e0fc03c27d
Jul 28 13:25:02.265640 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:02.265595    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch" event={"ID":"8ca1ae84-cc63-4d53-a19c-58f048aea2f6","Type":"ContainerStarted","Data":"026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8"}
Jul 28 13:25:02.266165 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:02.265799    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:25:02.266165 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:02.265836    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch" event={"ID":"8ca1ae84-cc63-4d53-a19c-58f048aea2f6","Type":"ContainerStarted","Data":"9f83c6318f5ee8649f6b8149fb7996c4166c4d9b0f42ab4d362694e0fc03c27d"}
Jul 28 13:25:02.287453 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:02.287388    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch" podStartSLOduration=1.287368429 podStartE2EDuration="1.287368429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:25:02.285186353 +0000 UTC m=+2029.214470270" watchObservedRunningTime="2026-07-28 13:25:02.287368429 +0000 UTC m=+2029.216652346"
Jul 28 13:25:13.275035 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:13.274992    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:25:14.337728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:14.337684    2567 generic.go:356] "Generic (PLEG): container finished" podID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerID="0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5" exitCode=0
Jul 28 13:25:14.338300 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:14.337761    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" event={"ID":"098f7e28-bc11-47fc-8c66-c5886ec295d6","Type":"ContainerDied","Data":"0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5"}
Jul 28 13:25:14.338300 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:14.338223    2567 scope.go:117] "RemoveContainer" containerID="0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5"
Jul 28 13:25:14.339386 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:14.339356    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:25:14.339443 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:14.339428    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:25:14.339479 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:14.339470    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:25:15.252339 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:15.252302    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:25:15.349514 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:15.349474    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" event={"ID":"098f7e28-bc11-47fc-8c66-c5886ec295d6","Type":"ContainerStarted","Data":"8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87"}
Jul 28 13:25:15.802238 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:15.802203    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:25:15.803333 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:15.803307    2567 patch_prober.go:28] interesting pod/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 28 13:25:15.803407 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:15.803368    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 28 13:25:16.802310 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:16.802273    2567 patch_prober.go:28] interesting pod/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 28 13:25:16.802694 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:16.802333    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 28 13:25:17.802340 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:17.802300    2567 patch_prober.go:28] interesting pod/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 28 13:25:17.802752 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:17.802358    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 28 13:25:18.802410 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:18.802359    2567 patch_prober.go:28] interesting pod/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 28 13:25:18.802895 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:18.802432    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 28 13:25:19.805603 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:19.805571    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:25:19.806060 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:19.805964    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:25:19.806567 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:19.806547    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:25:25.413398 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:25.413365    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:25:40.820735 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:25:40.820656    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:14.797125 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:14.797092    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:14.827339 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:14.827302    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"]
Jul 28 13:26:14.827596 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:14.827568    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch" podUID="8ca1ae84-cc63-4d53-a19c-58f048aea2f6" containerName="payload-pre-processing" containerID="cri-o://026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8" gracePeriod=30
Jul 28 13:26:14.896383 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:14.896345    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:14.971600 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:14.971566    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:15.027127 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.027099    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:15.095104 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.095078    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:26:15.195865 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.195830    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdr87\" (UniqueName: \"kubernetes.io/projected/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-kube-api-access-wdr87\") pod \"8ca1ae84-cc63-4d53-a19c-58f048aea2f6\" (UID: \"8ca1ae84-cc63-4d53-a19c-58f048aea2f6\") "
Jul 28 13:26:15.196065 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.195946    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-plugins-config-volume\") pod \"8ca1ae84-cc63-4d53-a19c-58f048aea2f6\" (UID: \"8ca1ae84-cc63-4d53-a19c-58f048aea2f6\") "
Jul 28 13:26:15.196314 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.196286    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ca1ae84-cc63-4d53-a19c-58f048aea2f6" (UID: "8ca1ae84-cc63-4d53-a19c-58f048aea2f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:26:15.198058 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.198036    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-kube-api-access-wdr87" (OuterVolumeSpecName: "kube-api-access-wdr87") pod "8ca1ae84-cc63-4d53-a19c-58f048aea2f6" (UID: "8ca1ae84-cc63-4d53-a19c-58f048aea2f6"). InnerVolumeSpecName "kube-api-access-wdr87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:26:15.296904 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.296869    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:26:15.296904 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.296897    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdr87\" (UniqueName: \"kubernetes.io/projected/8ca1ae84-cc63-4d53-a19c-58f048aea2f6-kube-api-access-wdr87\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:26:15.686168 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.686124    2567 generic.go:356] "Generic (PLEG): container finished" podID="8ca1ae84-cc63-4d53-a19c-58f048aea2f6" containerID="026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8" exitCode=0
Jul 28 13:26:15.686349 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.686179    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"
Jul 28 13:26:15.686349 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.686196    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch" event={"ID":"8ca1ae84-cc63-4d53-a19c-58f048aea2f6","Type":"ContainerDied","Data":"026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8"}
Jul 28 13:26:15.686349 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.686241    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch" event={"ID":"8ca1ae84-cc63-4d53-a19c-58f048aea2f6","Type":"ContainerDied","Data":"9f83c6318f5ee8649f6b8149fb7996c4166c4d9b0f42ab4d362694e0fc03c27d"}
Jul 28 13:26:15.686349 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.686262    2567 scope.go:117] "RemoveContainer" containerID="026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8"
Jul 28 13:26:15.695375 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.695354    2567 scope.go:117] "RemoveContainer" containerID="026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8"
Jul 28 13:26:15.695646 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:26:15.695626    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8\": container with ID starting with 026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8 not found: ID does not exist" containerID="026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8"
Jul 28 13:26:15.695709 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.695655    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8"} err="failed to get container status \"026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8\": rpc error: code = NotFound desc = could not find container \"026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8\": container with ID starting with 026c3ee0e5af17ccae7c5b80c31a6b9c9025b521bdff65dd3d31ea8a49c653e8 not found: ID does not exist"
Jul 28 13:26:15.703405 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.703381    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"]
Jul 28 13:26:15.707275 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:15.707247    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-11cb60ac-7c479d5676-m9bch"]
Jul 28 13:26:17.506026 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:17.505993    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ca1ae84-cc63-4d53-a19c-58f048aea2f6" path="/var/lib/kubelet/pods/8ca1ae84-cc63-4d53-a19c-58f048aea2f6/volumes"
Jul 28 13:26:18.727009 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:18.726970    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:23.821990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:23.821958    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:26:28.609595 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:26:28.609562    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:00.989241 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:00.989206    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:01.091239 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:01.091203    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:07.337269 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:07.337177    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:07.416244 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:07.416211    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:07.622998 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:07.622875    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"]
Jul 28 13:27:07.623186 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:07.623158    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy" containerID="cri-o://8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87" gracePeriod=30
Jul 28 13:27:07.657655 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:07.657621    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:07.906180 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:07.906085    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:09.105406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:09.105352    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:09.235130 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:09.235094    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:09.356010 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:09.355904    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:10.221015 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:10.220978    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:10.324460 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:10.324428    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:10.424738 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:10.424708    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:11.999994 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:11.999957    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:12.884116 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.884087    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:27:12.916979 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.916853    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-socket\") pod \"098f7e28-bc11-47fc-8c66-c5886ec295d6\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") "
Jul 28 13:27:12.916979 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.916901    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-data\") pod \"098f7e28-bc11-47fc-8c66-c5886ec295d6\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") "
Jul 28 13:27:12.916979 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.916956    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-envoy\") pod \"098f7e28-bc11-47fc-8c66-c5886ec295d6\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") "
Jul 28 13:27:12.917304 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.917003    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-certs\") pod \"098f7e28-bc11-47fc-8c66-c5886ec295d6\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") "
Jul 28 13:27:12.917304 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.917039    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-credential-socket\") pod \"098f7e28-bc11-47fc-8c66-c5886ec295d6\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") "
Jul 28 13:27:12.917304 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.917108    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-podinfo\") pod \"098f7e28-bc11-47fc-8c66-c5886ec295d6\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") "
Jul 28 13:27:12.917304 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.917137    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-token\") pod \"098f7e28-bc11-47fc-8c66-c5886ec295d6\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") "
Jul 28 13:27:12.917304 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.917189    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "098f7e28-bc11-47fc-8c66-c5886ec295d6" (UID: "098f7e28-bc11-47fc-8c66-c5886ec295d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:27:12.917304 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.917225    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098f7e28-bc11-47fc-8c66-c5886ec295d6-istiod-ca-cert\") pod \"098f7e28-bc11-47fc-8c66-c5886ec295d6\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") "
Jul 28 13:27:12.917304 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.917263    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkczs\" (UniqueName: \"kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-kube-api-access-gkczs\") pod \"098f7e28-bc11-47fc-8c66-c5886ec295d6\" (UID: \"098f7e28-bc11-47fc-8c66-c5886ec295d6\") "
Jul 28 13:27:12.917669 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.917544    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:27:12.918391 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.917902    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "098f7e28-bc11-47fc-8c66-c5886ec295d6" (UID: "098f7e28-bc11-47fc-8c66-c5886ec295d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:27:12.918391 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.918037    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "098f7e28-bc11-47fc-8c66-c5886ec295d6" (UID: "098f7e28-bc11-47fc-8c66-c5886ec295d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:27:12.918391 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.918223    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/098f7e28-bc11-47fc-8c66-c5886ec295d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "098f7e28-bc11-47fc-8c66-c5886ec295d6" (UID: "098f7e28-bc11-47fc-8c66-c5886ec295d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:27:12.918391 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.918299    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "098f7e28-bc11-47fc-8c66-c5886ec295d6" (UID: "098f7e28-bc11-47fc-8c66-c5886ec295d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:27:12.919958 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.919896    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "098f7e28-bc11-47fc-8c66-c5886ec295d6" (UID: "098f7e28-bc11-47fc-8c66-c5886ec295d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:27:12.920486 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.920093    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "098f7e28-bc11-47fc-8c66-c5886ec295d6" (UID: "098f7e28-bc11-47fc-8c66-c5886ec295d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:27:12.923250 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.923045    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "098f7e28-bc11-47fc-8c66-c5886ec295d6" (UID: "098f7e28-bc11-47fc-8c66-c5886ec295d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:27:12.923250 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:12.923054    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-kube-api-access-gkczs" (OuterVolumeSpecName: "kube-api-access-gkczs") pod "098f7e28-bc11-47fc-8c66-c5886ec295d6" (UID: "098f7e28-bc11-47fc-8c66-c5886ec295d6"). InnerVolumeSpecName "kube-api-access-gkczs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:27:13.012942 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.012892    2567 generic.go:356] "Generic (PLEG): container finished" podID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerID="8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87" exitCode=0
Jul 28 13:27:13.013436 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.012968    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" event={"ID":"098f7e28-bc11-47fc-8c66-c5886ec295d6","Type":"ContainerDied","Data":"8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87"}
Jul 28 13:27:13.013436 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.013001    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"
Jul 28 13:27:13.013436 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.013037    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4" event={"ID":"098f7e28-bc11-47fc-8c66-c5886ec295d6","Type":"ContainerDied","Data":"8070dc5a9ff332d6f3c465e2db84db7a1636dd6dace89600cf4be2d252db8339"}
Jul 28 13:27:13.013436 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.013065    2567 scope.go:117] "RemoveContainer" containerID="8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87"
Jul 28 13:27:13.018940 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.018376    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/098f7e28-bc11-47fc-8c66-c5886ec295d6-istiod-ca-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:27:13.018940 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.018405    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkczs\" (UniqueName: \"kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-kube-api-access-gkczs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:27:13.018940 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.018422    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-data\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:27:13.018940 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.018437    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-envoy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:27:13.018940 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.018450    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-workload-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:27:13.018940 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.018463    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/098f7e28-bc11-47fc-8c66-c5886ec295d6-credential-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:27:13.018940 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.018475    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-podinfo\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:27:13.018940 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.018489    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/098f7e28-bc11-47fc-8c66-c5886ec295d6-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:27:13.033175 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.033032    2567 scope.go:117] "RemoveContainer" containerID="0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5"
Jul 28 13:27:13.051943 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.050951    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"]
Jul 28 13:27:13.058807 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.058237    2567 scope.go:117] "RemoveContainer" containerID="8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87"
Jul 28 13:27:13.058807 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.058274    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-11cb60ac-openshift-default-6967879c9b-pd4v4"]
Jul 28 13:27:13.058807 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:27:13.058692    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87\": container with ID starting with 8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87 not found: ID does not exist" containerID="8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87"
Jul 28 13:27:13.058807 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.058727    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87"} err="failed to get container status \"8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87\": rpc error: code = NotFound desc = could not find container \"8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87\": container with ID starting with 8a3374add5e880073f0813ffd01ab7c6fb546964bc11d430e2362ce1bc297d87 not found: ID does not exist"
Jul 28 13:27:13.058807 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.058750    2567 scope.go:117] "RemoveContainer" containerID="0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5"
Jul 28 13:27:13.059210 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:27:13.059083    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5\": container with ID starting with 0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5 not found: ID does not exist" containerID="0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5"
Jul 28 13:27:13.059210 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.059115    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5"} err="failed to get container status \"0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5\": rpc error: code = NotFound desc = could not find container \"0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5\": container with ID starting with 0046e569b7d5f21690b2d0bd69be3be24cb1668d51b92543b065fc7d8009e1c5 not found: ID does not exist"
Jul 28 13:27:13.510534 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.510492    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" path="/var/lib/kubelet/pods/098f7e28-bc11-47fc-8c66-c5886ec295d6/volumes"
Jul 28 13:27:13.763591 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:13.763493    2567 scope.go:117] "RemoveContainer" containerID="4ed9a16dcf73877acf0eda9a80e3b64c5484f1ffce3831bd4f7241d2f16f945b"
Jul 28 13:27:18.784902 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:18.784853    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:18.884193 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:18.884155    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:19.480172 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:19.480139    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:26.904537 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:26.904483    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:27.022263 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:27.022205    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:27.173078 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:27.172970    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:37.680257 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:37.680194    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:38.044382 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:38.044349    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:42.846537 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:42.846499    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:44.300146 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:44.300118    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:27:59.018296 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:27:59.018266    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:05.581205 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:05.581153    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:05.681395 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:05.681353    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:05.973416 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:05.973317    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:06.269487 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.269459    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"]
Jul 28 13:28:06.269814 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.269802    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy"
Jul 28 13:28:06.269858 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.269816    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy"
Jul 28 13:28:06.269858 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.269825    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca1ae84-cc63-4d53-a19c-58f048aea2f6" containerName="payload-pre-processing"
Jul 28 13:28:06.269858 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.269830    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca1ae84-cc63-4d53-a19c-58f048aea2f6" containerName="payload-pre-processing"
Jul 28 13:28:06.269858 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.269853    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy"
Jul 28 13:28:06.269858 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.269859    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy"
Jul 28 13:28:06.270053 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.269909    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy"
Jul 28 13:28:06.270053 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.269932    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ca1ae84-cc63-4d53-a19c-58f048aea2f6" containerName="payload-pre-processing"
Jul 28 13:28:06.276136 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.274241    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.277391 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.277366    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8b4f72-openshift-default-dockercfg-hxmr8\""
Jul 28 13:28:06.290221 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.290191    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"]
Jul 28 13:28:06.300496 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.300466    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:06.399421 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.399383    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-credential-socket\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.399609 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.399429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlccg\" (UniqueName: \"kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-kube-api-access-nlccg\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.399609 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.399452    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-certs\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.399609 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.399560    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-envoy\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.399724 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.399608    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istiod-ca-cert\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.399724 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.399695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-socket\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.399791 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.399772    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-token\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.399828 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.399811    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-podinfo\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.399866 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.399844    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-data\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.500433 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.500395    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-envoy\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.500637 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.500450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istiod-ca-cert\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.500637 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.500499    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-socket\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.500637 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.500547    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-token\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.500637 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.500578    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-podinfo\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.500637 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.500610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-data\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.500948 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.500645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-credential-socket\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.501075 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.500670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlccg\" (UniqueName: \"kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-kube-api-access-nlccg\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.501204 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.500934    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-socket\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.501286 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.501021    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-data\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.501286 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.501082    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-credential-socket\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.501286 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.501158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-certs\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.501455 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.501303    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istiod-ca-cert\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.501636 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.501610    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-certs\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.503503 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.503474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-podinfo\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.503886 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.503867    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-envoy\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.509910 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.509876    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-token\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.510087 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.510022    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlccg\" (UniqueName: \"kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-kube-api-access-nlccg\") pod \"e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") " pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.587106 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.586986    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:06.712149 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.712113    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:06.740514 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.740481    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"]
Jul 28 13:28:06.741252 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:28:06.741222    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ae532d_ef78_48b4_a066_7b3b1f1d8b1b.slice/crio-3e53fa8a7e728bc2343e6f994be647beffae735fb8eeb4cc0d33a9f98f74ea6b WatchSource:0}: Error finding container 3e53fa8a7e728bc2343e6f994be647beffae735fb8eeb4cc0d33a9f98f74ea6b: Status 404 returned error can't find the container with id 3e53fa8a7e728bc2343e6f994be647beffae735fb8eeb4cc0d33a9f98f74ea6b
Jul 28 13:28:06.743616 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.743575    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:28:06.743693 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.743665    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:28:06.743731 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:06.743706    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:28:07.319287 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:07.319253    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" event={"ID":"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b","Type":"ContainerStarted","Data":"d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167"}
Jul 28 13:28:07.319471 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:07.319308    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" event={"ID":"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b","Type":"ContainerStarted","Data":"3e53fa8a7e728bc2343e6f994be647beffae735fb8eeb4cc0d33a9f98f74ea6b"}
Jul 28 13:28:07.344893 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:07.344835    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" podStartSLOduration=1.3448184 podStartE2EDuration="1.3448184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:28:07.342093473 +0000 UTC m=+2214.271377390" watchObservedRunningTime="2026-07-28 13:28:07.3448184 +0000 UTC m=+2214.274102316"
Jul 28 13:28:07.587350 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:07.587256    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:07.592601 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:07.592574    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:08.324689 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:08.324658    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:08.325588 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:08.325567    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:09.332065 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:09.332021    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:09.424630 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:09.424600    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:09.587275 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:09.587191    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:09.909814 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:09.909725    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:10.273885 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.273854    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:10.377900 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.377868    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:10.391713 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.391682    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"]
Jul 28 13:28:10.392106 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.392094    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="098f7e28-bc11-47fc-8c66-c5886ec295d6" containerName="istio-proxy"
Jul 28 13:28:10.395245 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.395223    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:28:10.399243 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.399223    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-8b4f72\""
Jul 28 13:28:10.408497 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.408471    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"]
Jul 28 13:28:10.439094 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.439055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49ebcb67-c4d7-421e-8e09-a52d23ebff71-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk\" (UID: \"49ebcb67-c4d7-421e-8e09-a52d23ebff71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:28:10.439331 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.439305    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjwwg\" (UniqueName: \"kubernetes.io/projected/49ebcb67-c4d7-421e-8e09-a52d23ebff71-kube-api-access-jjwwg\") pod \"payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk\" (UID: \"49ebcb67-c4d7-421e-8e09-a52d23ebff71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:28:10.454871 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.454836    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"]
Jul 28 13:28:10.458471 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.458453    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:28:10.461507 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.461477    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-8b4f72-dockercfg-p6b22\""
Jul 28 13:28:10.468482 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.468455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"]
Jul 28 13:28:10.540713 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.540616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjwwg\" (UniqueName: \"kubernetes.io/projected/49ebcb67-c4d7-421e-8e09-a52d23ebff71-kube-api-access-jjwwg\") pod \"payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk\" (UID: \"49ebcb67-c4d7-421e-8e09-a52d23ebff71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:28:10.540713 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.540680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw7ds\" (UniqueName: \"kubernetes.io/projected/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-kube-api-access-lw7ds\") pod \"payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c\" (UID: \"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:28:10.540991 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.540753    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49ebcb67-c4d7-421e-8e09-a52d23ebff71-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk\" (UID: \"49ebcb67-c4d7-421e-8e09-a52d23ebff71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:28:10.540991 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.540781    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c\" (UID: \"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:28:10.541730 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.541701    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49ebcb67-c4d7-421e-8e09-a52d23ebff71-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk\" (UID: \"49ebcb67-c4d7-421e-8e09-a52d23ebff71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:28:10.551156 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.551125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjwwg\" (UniqueName: \"kubernetes.io/projected/49ebcb67-c4d7-421e-8e09-a52d23ebff71-kube-api-access-jjwwg\") pod \"payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk\" (UID: \"49ebcb67-c4d7-421e-8e09-a52d23ebff71\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:28:10.641743 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.641701    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c\" (UID: \"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:28:10.641963 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.641843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw7ds\" (UniqueName: \"kubernetes.io/projected/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-kube-api-access-lw7ds\") pod \"payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c\" (UID: \"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:28:10.642511 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.642487    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c\" (UID: \"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:28:10.651263 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.651236    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw7ds\" (UniqueName: \"kubernetes.io/projected/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-kube-api-access-lw7ds\") pod \"payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c\" (UID: \"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:28:10.708933 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.708890    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:28:10.769949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.769902    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:28:10.869020 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.868904    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"]
Jul 28 13:28:10.870568 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:28:10.870543    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ebcb67_c4d7_421e_8e09_a52d23ebff71.slice/crio-c26325cf56b28e17e08a8ecb2b16faabb9f2e719d2c922b89fc20d53a6f9a989 WatchSource:0}: Error finding container c26325cf56b28e17e08a8ecb2b16faabb9f2e719d2c922b89fc20d53a6f9a989: Status 404 returned error can't find the container with id c26325cf56b28e17e08a8ecb2b16faabb9f2e719d2c922b89fc20d53a6f9a989
Jul 28 13:28:10.927074 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:10.927049    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"]
Jul 28 13:28:10.932400 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:28:10.932357    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d5d51e_483e_4f4b_b6c3_2a0e27d7be1c.slice/crio-a0009050d746b03a241ae687eeeec24a4ee8f4b7e6ae8aaf3d4d453f3e66dc1b WatchSource:0}: Error finding container a0009050d746b03a241ae687eeeec24a4ee8f4b7e6ae8aaf3d4d453f3e66dc1b: Status 404 returned error can't find the container with id a0009050d746b03a241ae687eeeec24a4ee8f4b7e6ae8aaf3d4d453f3e66dc1b
Jul 28 13:28:11.346849 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:11.346818    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c" event={"ID":"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c","Type":"ContainerStarted","Data":"4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8"}
Jul 28 13:28:11.347085 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:11.346966    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:28:11.347085 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:11.347004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c" event={"ID":"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c","Type":"ContainerStarted","Data":"a0009050d746b03a241ae687eeeec24a4ee8f4b7e6ae8aaf3d4d453f3e66dc1b"}
Jul 28 13:28:11.348575 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:11.348545    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk" event={"ID":"49ebcb67-c4d7-421e-8e09-a52d23ebff71","Type":"ContainerStarted","Data":"46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519"}
Jul 28 13:28:11.348666 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:11.348599    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk" event={"ID":"49ebcb67-c4d7-421e-8e09-a52d23ebff71","Type":"ContainerStarted","Data":"c26325cf56b28e17e08a8ecb2b16faabb9f2e719d2c922b89fc20d53a6f9a989"}
Jul 28 13:28:11.348666 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:11.348653    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:28:11.366020 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:11.365971    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c" podStartSLOduration=1.365953363 podStartE2EDuration="1.365953363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:28:11.36314871 +0000 UTC m=+2218.292432642" watchObservedRunningTime="2026-07-28 13:28:11.365953363 +0000 UTC m=+2218.295237280"
Jul 28 13:28:11.383646 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:11.383590    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk" podStartSLOduration=1.3835757260000001 podStartE2EDuration="1.383575726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:28:11.382807822 +0000 UTC m=+2218.312091740" watchObservedRunningTime="2026-07-28 13:28:11.383575726 +0000 UTC m=+2218.312859644"
Jul 28 13:28:13.797504 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:13.797467    2567 scope.go:117] "RemoveContainer" containerID="a6e8356c85779d79fc9dedc464dd5144c53d679f29a80f7041e81fc8c43fe992"
Jul 28 13:28:22.356119 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:22.356083    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:28:22.356539 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:22.356231    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:28:24.367122 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:24.367072    2567 patch_prober.go:28] interesting pod/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 13:28:24.367637 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:24.367146    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 13:28:25.429411 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:25.429379    2567 generic.go:356] "Generic (PLEG): container finished" podID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerID="d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167" exitCode=0
Jul 28 13:28:25.429912 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:25.429434    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" event={"ID":"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b","Type":"ContainerDied","Data":"d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167"}
Jul 28 13:28:25.429912 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:25.429812    2567 scope.go:117] "RemoveContainer" containerID="d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167"
Jul 28 13:28:25.430845 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:25.430819    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:28:25.430958 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:25.430904    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:28:25.431031 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:25.430973    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:28:26.440671 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:26.440621    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" event={"ID":"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b","Type":"ContainerStarted","Data":"cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a"}
Jul 28 13:28:26.587738 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:26.587705    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:26.587987 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:26.587964    2567 patch_prober.go:28] interesting pod/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 28 13:28:26.588048 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:26.588017    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 28 13:28:27.587705 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:27.587658    2567 patch_prober.go:28] interesting pod/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 28 13:28:27.588252 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:27.587733    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 28 13:28:28.588043 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:28.588006    2567 patch_prober.go:28] interesting pod/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 28 13:28:28.588445 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:28.588082    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 28 13:28:29.588248 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:29.588200    2567 patch_prober.go:28] interesting pod/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 28 13:28:29.588685 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:29.588267    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 28 13:28:30.591361 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:30.591331    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:30.591781 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:30.591762    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:30.592461 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:30.592442    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:28:34.357265 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:34.357230    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:34.741037 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:34.740912    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:35.203101 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:35.203014    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:35.681310 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:35.681277    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:40.574383 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:40.574350    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:40.652563 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:40.652531    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:40.723305 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:40.723271    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:41.170733 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.170686    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:41.270052 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.270007    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:41.347291 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.347255    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:28:41.381895 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.381863    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"]
Jul 28 13:28:41.385887 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.385868    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:28:41.388358 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.388324    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-d82b76-dockercfg-85bnb\""
Jul 28 13:28:41.388499 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.388335    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-d82b76\""
Jul 28 13:28:41.396275 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.396245    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"]
Jul 28 13:28:41.465882 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.465793    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwf5d\" (UniqueName: \"kubernetes.io/projected/3c72bf4c-7425-45ac-8472-8f72eb1326e9-kube-api-access-gwf5d\") pod \"payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf\" (UID: \"3c72bf4c-7425-45ac-8472-8f72eb1326e9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:28:41.466106 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.465997    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c72bf4c-7425-45ac-8472-8f72eb1326e9-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf\" (UID: \"3c72bf4c-7425-45ac-8472-8f72eb1326e9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:28:41.567522 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.567481    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwf5d\" (UniqueName: \"kubernetes.io/projected/3c72bf4c-7425-45ac-8472-8f72eb1326e9-kube-api-access-gwf5d\") pod \"payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf\" (UID: \"3c72bf4c-7425-45ac-8472-8f72eb1326e9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:28:41.567708 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.567527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c72bf4c-7425-45ac-8472-8f72eb1326e9-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf\" (UID: \"3c72bf4c-7425-45ac-8472-8f72eb1326e9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:28:41.568322 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.568304    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c72bf4c-7425-45ac-8472-8f72eb1326e9-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf\" (UID: \"3c72bf4c-7425-45ac-8472-8f72eb1326e9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:28:41.576224 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.576190    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwf5d\" (UniqueName: \"kubernetes.io/projected/3c72bf4c-7425-45ac-8472-8f72eb1326e9-kube-api-access-gwf5d\") pod \"payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf\" (UID: \"3c72bf4c-7425-45ac-8472-8f72eb1326e9\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:28:41.698607 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.698566    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:28:41.842207 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:41.842129    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"]
Jul 28 13:28:41.844085 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:28:41.844046    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c72bf4c_7425_45ac_8472_8f72eb1326e9.slice/crio-a542b9fe4ca52fb3dd8a85908976c9da637258571affcf5623fe4418cc0c1070 WatchSource:0}: Error finding container a542b9fe4ca52fb3dd8a85908976c9da637258571affcf5623fe4418cc0c1070: Status 404 returned error can't find the container with id a542b9fe4ca52fb3dd8a85908976c9da637258571affcf5623fe4418cc0c1070
Jul 28 13:28:42.536996 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:42.536956    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf" event={"ID":"3c72bf4c-7425-45ac-8472-8f72eb1326e9","Type":"ContainerStarted","Data":"9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605"}
Jul 28 13:28:42.537212 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:42.537027    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf" event={"ID":"3c72bf4c-7425-45ac-8472-8f72eb1326e9","Type":"ContainerStarted","Data":"a542b9fe4ca52fb3dd8a85908976c9da637258571affcf5623fe4418cc0c1070"}
Jul 28 13:28:42.537212 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:42.537056    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:28:42.559116 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:42.559057    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf" podStartSLOduration=1.5590417269999999 podStartE2EDuration="1.559041727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:28:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:28:42.55804249 +0000 UTC m=+2249.487326407" watchObservedRunningTime="2026-07-28 13:28:42.559041727 +0000 UTC m=+2249.488325644"
Jul 28 13:28:53.545175 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:28:53.545142    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:29:05.876089 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:29:05.876057    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:29:13.820907 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:29:13.820867    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:29:15.723908 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:29:15.723875    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:29:49.117847 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:29:49.117814    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:00.137502 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.137465    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww"]
Jul 28 13:30:00.141634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.141603    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2"]
Jul 28 13:30:00.141793 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.141719    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww"
Jul 28 13:30:00.144270 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.144245    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6qfh\""
Jul 28 13:30:00.145625 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.145604    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht"]
Jul 28 13:30:00.145737 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.145682    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2"
Jul 28 13:30:00.149617 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.149589    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht"
Jul 28 13:30:00.149964 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.149935    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww"]
Jul 28 13:30:00.156302 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.156265    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht"]
Jul 28 13:30:00.157278 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.157251    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww"
Jul 28 13:30:00.160134 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.159982    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2"]
Jul 28 13:30:00.170584 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.170555    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2"
Jul 28 13:30:00.213304 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.213272    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht"
Jul 28 13:30:00.353752 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.353693    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww"]
Jul 28 13:30:00.356090 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:30:00.356058    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25aa573d_f64c_49d8_ac18_b061b050e6ba.slice/crio-528b7fe17580b269db20b69cb752c8337b74803b5ee4133362250b037c68b581 WatchSource:0}: Error finding container 528b7fe17580b269db20b69cb752c8337b74803b5ee4133362250b037c68b581: Status 404 returned error can't find the container with id 528b7fe17580b269db20b69cb752c8337b74803b5ee4133362250b037c68b581
Jul 28 13:30:00.400730 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.400699    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2"]
Jul 28 13:30:00.403039 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:30:00.402996    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6da48ea_744a_4d90_bcde_74d2b1fd7b63.slice/crio-610c2d2c0a8841cd69e431eeff22557aa60982e7b16dba484836b5ec7164c66d WatchSource:0}: Error finding container 610c2d2c0a8841cd69e431eeff22557aa60982e7b16dba484836b5ec7164c66d: Status 404 returned error can't find the container with id 610c2d2c0a8841cd69e431eeff22557aa60982e7b16dba484836b5ec7164c66d
Jul 28 13:30:00.429714 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.429686    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht"]
Jul 28 13:30:00.435361 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:30:00.435330    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee889193_a134_4c82_a82d_cbb7429469b8.slice/crio-9d59a0f97a2a3d6420b6053b6336e94f31d70c104f91d3fc59064d966a9b1858 WatchSource:0}: Error finding container 9d59a0f97a2a3d6420b6053b6336e94f31d70c104f91d3fc59064d966a9b1858: Status 404 returned error can't find the container with id 9d59a0f97a2a3d6420b6053b6336e94f31d70c104f91d3fc59064d966a9b1858
Jul 28 13:30:00.976713 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.976677    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww" event={"ID":"25aa573d-f64c-49d8-ac18-b061b050e6ba","Type":"ContainerStarted","Data":"f12417d1468b9aa86cfb4adb5e5e293432c2f050317d0feecb8146b9420a6d0d"}
Jul 28 13:30:00.976953 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.976739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww" event={"ID":"25aa573d-f64c-49d8-ac18-b061b050e6ba","Type":"ContainerStarted","Data":"528b7fe17580b269db20b69cb752c8337b74803b5ee4133362250b037c68b581"}
Jul 28 13:30:00.978425 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.978397    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht" event={"ID":"ee889193-a134-4c82-a82d-cbb7429469b8","Type":"ContainerStarted","Data":"ce9e6d83e474fdecc8ec29750d2425afae87321fbe548363c84746bdc4354791"}
Jul 28 13:30:00.978561 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.978441    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht" event={"ID":"ee889193-a134-4c82-a82d-cbb7429469b8","Type":"ContainerStarted","Data":"9d59a0f97a2a3d6420b6053b6336e94f31d70c104f91d3fc59064d966a9b1858"}
Jul 28 13:30:00.980103 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.980076    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2" event={"ID":"c6da48ea-744a-4d90-bcde-74d2b1fd7b63","Type":"ContainerStarted","Data":"8b1e73023965f154ea717f2b9cb7db18c15ff74b912e2ea99cdc5e603365a8fc"}
Jul 28 13:30:00.980217 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.980122    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2" event={"ID":"c6da48ea-744a-4d90-bcde-74d2b1fd7b63","Type":"ContainerStarted","Data":"610c2d2c0a8841cd69e431eeff22557aa60982e7b16dba484836b5ec7164c66d"}
Jul 28 13:30:00.993987 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:00.993867    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww" podStartSLOduration=0.99385042 podStartE2EDuration="993.85042ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:30:00.99071537 +0000 UTC m=+2327.919999288" watchObservedRunningTime="2026-07-28 13:30:00.99385042 +0000 UTC m=+2327.923134371"
Jul 28 13:30:01.005980 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:01.005911    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht" podStartSLOduration=1.005892717 podStartE2EDuration="1.005892717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:30:01.004191583 +0000 UTC m=+2327.933475494" watchObservedRunningTime="2026-07-28 13:30:01.005892717 +0000 UTC m=+2327.935176633"
Jul 28 13:30:01.021048 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:01.020989    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2" podStartSLOduration=1.020966547 podStartE2EDuration="1.020966547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:30:01.018122603 +0000 UTC m=+2327.947406521" watchObservedRunningTime="2026-07-28 13:30:01.020966547 +0000 UTC m=+2327.950250466"
Jul 28 13:30:01.993390 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:01.993297    2567 generic.go:356] "Generic (PLEG): container finished" podID="25aa573d-f64c-49d8-ac18-b061b050e6ba" containerID="f12417d1468b9aa86cfb4adb5e5e293432c2f050317d0feecb8146b9420a6d0d" exitCode=0
Jul 28 13:30:01.993800 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:01.993383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww" event={"ID":"25aa573d-f64c-49d8-ac18-b061b050e6ba","Type":"ContainerDied","Data":"f12417d1468b9aa86cfb4adb5e5e293432c2f050317d0feecb8146b9420a6d0d"}
Jul 28 13:30:01.994992 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:01.994968    2567 generic.go:356] "Generic (PLEG): container finished" podID="ee889193-a134-4c82-a82d-cbb7429469b8" containerID="ce9e6d83e474fdecc8ec29750d2425afae87321fbe548363c84746bdc4354791" exitCode=0
Jul 28 13:30:01.995110 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:01.995052    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht" event={"ID":"ee889193-a134-4c82-a82d-cbb7429469b8","Type":"ContainerDied","Data":"ce9e6d83e474fdecc8ec29750d2425afae87321fbe548363c84746bdc4354791"}
Jul 28 13:30:01.996465 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:01.996445    2567 generic.go:356] "Generic (PLEG): container finished" podID="c6da48ea-744a-4d90-bcde-74d2b1fd7b63" containerID="8b1e73023965f154ea717f2b9cb7db18c15ff74b912e2ea99cdc5e603365a8fc" exitCode=0
Jul 28 13:30:01.996570 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:01.996502    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2" event={"ID":"c6da48ea-744a-4d90-bcde-74d2b1fd7b63","Type":"ContainerDied","Data":"8b1e73023965f154ea717f2b9cb7db18c15ff74b912e2ea99cdc5e603365a8fc"}
Jul 28 13:30:03.150789 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:03.150755    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2"
Jul 28 13:30:03.189639 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:03.189612    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht"
Jul 28 13:30:03.193034 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:03.193009    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww"
Jul 28 13:30:04.009717 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:04.009687    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2"
Jul 28 13:30:04.009912 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:04.009725    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2" event={"ID":"c6da48ea-744a-4d90-bcde-74d2b1fd7b63","Type":"ContainerDied","Data":"610c2d2c0a8841cd69e431eeff22557aa60982e7b16dba484836b5ec7164c66d"}
Jul 28 13:30:04.009912 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:04.009772    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="610c2d2c0a8841cd69e431eeff22557aa60982e7b16dba484836b5ec7164c66d"
Jul 28 13:30:04.011166 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:04.011147    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww"
Jul 28 13:30:04.011296 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:04.011184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww" event={"ID":"25aa573d-f64c-49d8-ac18-b061b050e6ba","Type":"ContainerDied","Data":"528b7fe17580b269db20b69cb752c8337b74803b5ee4133362250b037c68b581"}
Jul 28 13:30:04.011296 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:04.011223    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="528b7fe17580b269db20b69cb752c8337b74803b5ee4133362250b037c68b581"
Jul 28 13:30:04.012662 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:04.012637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht" event={"ID":"ee889193-a134-4c82-a82d-cbb7429469b8","Type":"ContainerDied","Data":"9d59a0f97a2a3d6420b6053b6336e94f31d70c104f91d3fc59064d966a9b1858"}
Jul 28 13:30:04.012662 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:04.012658    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754090-fvlht"
Jul 28 13:30:04.012858 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:04.012674    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d59a0f97a2a3d6420b6053b6336e94f31d70c104f91d3fc59064d966a9b1858"
Jul 28 13:30:30.799094 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:30.799049    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:31.748276 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.748235    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:31.872175 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.872139    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"]
Jul 28 13:30:31.872565 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.872526    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee889193-a134-4c82-a82d-cbb7429469b8" containerName="cleanup"
Jul 28 13:30:31.872565 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.872537    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee889193-a134-4c82-a82d-cbb7429469b8" containerName="cleanup"
Jul 28 13:30:31.872565 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.872549    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25aa573d-f64c-49d8-ac18-b061b050e6ba" containerName="cleanup"
Jul 28 13:30:31.872565 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.872554    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="25aa573d-f64c-49d8-ac18-b061b050e6ba" containerName="cleanup"
Jul 28 13:30:31.872565 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.872566    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6da48ea-744a-4d90-bcde-74d2b1fd7b63" containerName="cleanup"
Jul 28 13:30:31.872731 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.872571    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6da48ea-744a-4d90-bcde-74d2b1fd7b63" containerName="cleanup"
Jul 28 13:30:31.872731 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.872633    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="25aa573d-f64c-49d8-ac18-b061b050e6ba" containerName="cleanup"
Jul 28 13:30:31.872731 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.872641    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee889193-a134-4c82-a82d-cbb7429469b8" containerName="cleanup"
Jul 28 13:30:31.872731 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.872649    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6da48ea-744a-4d90-bcde-74d2b1fd7b63" containerName="cleanup"
Jul 28 13:30:31.876475 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.876452    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"
Jul 28 13:30:31.878839 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.878813    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 13:30:31.879082 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.878904    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6qfh\""
Jul 28 13:30:31.884126 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.884097    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"]
Jul 28 13:30:31.906876 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:31.906843    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73fea2fa-055e-410e-a1ec-b15e59104318-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z\" (UID: \"73fea2fa-055e-410e-a1ec-b15e59104318\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"
Jul 28 13:30:32.007991 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:32.007854    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73fea2fa-055e-410e-a1ec-b15e59104318-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z\" (UID: \"73fea2fa-055e-410e-a1ec-b15e59104318\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"
Jul 28 13:30:32.008572 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:32.008545    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73fea2fa-055e-410e-a1ec-b15e59104318-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z\" (UID: \"73fea2fa-055e-410e-a1ec-b15e59104318\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"
Jul 28 13:30:32.188458 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:32.188410    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"
Jul 28 13:30:32.328163 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:32.328132    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"]
Jul 28 13:30:32.330069 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:30:32.330037    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73fea2fa_055e_410e_a1ec_b15e59104318.slice/crio-d2c43fa5728f16b9a21c0910d2a16ce7e482c573dc32d47b8a416bf067a4a08d WatchSource:0}: Error finding container d2c43fa5728f16b9a21c0910d2a16ce7e482c573dc32d47b8a416bf067a4a08d: Status 404 returned error can't find the container with id d2c43fa5728f16b9a21c0910d2a16ce7e482c573dc32d47b8a416bf067a4a08d
Jul 28 13:30:33.177323 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:33.177290    2567 generic.go:356] "Generic (PLEG): container finished" podID="73fea2fa-055e-410e-a1ec-b15e59104318" containerID="cc27461d7c8ec77a452392506d0e8bfbe9e40232a2452ce364d7e8f119540711" exitCode=0
Jul 28 13:30:33.177714 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:33.177368    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z" event={"ID":"73fea2fa-055e-410e-a1ec-b15e59104318","Type":"ContainerDied","Data":"cc27461d7c8ec77a452392506d0e8bfbe9e40232a2452ce364d7e8f119540711"}
Jul 28 13:30:33.177714 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:33.177429    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z" event={"ID":"73fea2fa-055e-410e-a1ec-b15e59104318","Type":"ContainerStarted","Data":"d2c43fa5728f16b9a21c0910d2a16ce7e482c573dc32d47b8a416bf067a4a08d"}
Jul 28 13:30:34.321437 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:34.321411    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"
Jul 28 13:30:34.432147 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:34.432117    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73fea2fa-055e-410e-a1ec-b15e59104318-maas-api-service-ca\") pod \"73fea2fa-055e-410e-a1ec-b15e59104318\" (UID: \"73fea2fa-055e-410e-a1ec-b15e59104318\") "
Jul 28 13:30:34.432505 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:34.432479    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73fea2fa-055e-410e-a1ec-b15e59104318-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "73fea2fa-055e-410e-a1ec-b15e59104318" (UID: "73fea2fa-055e-410e-a1ec-b15e59104318"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:30:34.533326 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:34.533295    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73fea2fa-055e-410e-a1ec-b15e59104318-maas-api-service-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:35.190183 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:35.190141    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"
Jul 28 13:30:35.190366 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:35.190186    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z" event={"ID":"73fea2fa-055e-410e-a1ec-b15e59104318","Type":"ContainerDied","Data":"d2c43fa5728f16b9a21c0910d2a16ce7e482c573dc32d47b8a416bf067a4a08d"}
Jul 28 13:30:35.190366 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:35.190245    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2c43fa5728f16b9a21c0910d2a16ce7e482c573dc32d47b8a416bf067a4a08d"
Jul 28 13:30:42.459803 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.459766    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2"]
Jul 28 13:30:42.463808 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.463775    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:42.465840 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.465816    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-8b4f72-29754090-whnt2"]
Jul 28 13:30:42.493409 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.493369    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"]
Jul 28 13:30:42.493705 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.493676    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk" podUID="49ebcb67-c4d7-421e-8e09-a52d23ebff71" containerName="payload-processing" containerID="cri-o://46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519" gracePeriod=30
Jul 28 13:30:42.499361 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.499334    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"]
Jul 28 13:30:42.499745 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.499712    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c" podUID="73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c" containerName="payload-pre-processing" containerID="cri-o://4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8" gracePeriod=30
Jul 28 13:30:42.534268 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.534061    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:42.634643 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.634579    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:42.654705 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.654664    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"]
Jul 28 13:30:42.658588 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.658540    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8b4f72-fm62z"]
Jul 28 13:30:42.695065 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.695021    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:42.764481 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.764455    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:30:42.801169 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.801143    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:30:42.813571 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.813544    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49ebcb67-c4d7-421e-8e09-a52d23ebff71-plugins-config-volume\") pod \"49ebcb67-c4d7-421e-8e09-a52d23ebff71\" (UID: \"49ebcb67-c4d7-421e-8e09-a52d23ebff71\") "
Jul 28 13:30:42.813727 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.813584    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjwwg\" (UniqueName: \"kubernetes.io/projected/49ebcb67-c4d7-421e-8e09-a52d23ebff71-kube-api-access-jjwwg\") pod \"49ebcb67-c4d7-421e-8e09-a52d23ebff71\" (UID: \"49ebcb67-c4d7-421e-8e09-a52d23ebff71\") "
Jul 28 13:30:42.813969 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.813950    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49ebcb67-c4d7-421e-8e09-a52d23ebff71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49ebcb67-c4d7-421e-8e09-a52d23ebff71" (UID: "49ebcb67-c4d7-421e-8e09-a52d23ebff71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:30:42.815748 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.815722    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49ebcb67-c4d7-421e-8e09-a52d23ebff71-kube-api-access-jjwwg" (OuterVolumeSpecName: "kube-api-access-jjwwg") pod "49ebcb67-c4d7-421e-8e09-a52d23ebff71" (UID: "49ebcb67-c4d7-421e-8e09-a52d23ebff71"). InnerVolumeSpecName "kube-api-access-jjwwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:30:42.914708 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.914668    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw7ds\" (UniqueName: \"kubernetes.io/projected/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-kube-api-access-lw7ds\") pod \"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c\" (UID: \"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c\") "
Jul 28 13:30:42.914708 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.914713    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-plugins-config-volume\") pod \"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c\" (UID: \"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c\") "
Jul 28 13:30:42.915078 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.915059    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49ebcb67-c4d7-421e-8e09-a52d23ebff71-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:42.915135 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.915082    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjwwg\" (UniqueName: \"kubernetes.io/projected/49ebcb67-c4d7-421e-8e09-a52d23ebff71-kube-api-access-jjwwg\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:42.915188 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.915162    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c" (UID: "73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:30:42.916762 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:42.916742    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-kube-api-access-lw7ds" (OuterVolumeSpecName: "kube-api-access-lw7ds") pod "73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c" (UID: "73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c"). InnerVolumeSpecName "kube-api-access-lw7ds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:30:43.016357 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.016328    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw7ds\" (UniqueName: \"kubernetes.io/projected/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-kube-api-access-lw7ds\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:43.016357 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.016356    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:43.022854 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.022827    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:43.236311 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.236278    2567 generic.go:356] "Generic (PLEG): container finished" podID="49ebcb67-c4d7-421e-8e09-a52d23ebff71" containerID="46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519" exitCode=0
Jul 28 13:30:43.236523 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.236322    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"
Jul 28 13:30:43.236523 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.236358    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk" event={"ID":"49ebcb67-c4d7-421e-8e09-a52d23ebff71","Type":"ContainerDied","Data":"46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519"}
Jul 28 13:30:43.236523 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.236406    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk" event={"ID":"49ebcb67-c4d7-421e-8e09-a52d23ebff71","Type":"ContainerDied","Data":"c26325cf56b28e17e08a8ecb2b16faabb9f2e719d2c922b89fc20d53a6f9a989"}
Jul 28 13:30:43.236523 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.236428    2567 scope.go:117] "RemoveContainer" containerID="46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519"
Jul 28 13:30:43.238188 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.238163    2567 generic.go:356] "Generic (PLEG): container finished" podID="73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c" containerID="4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8" exitCode=0
Jul 28 13:30:43.238337 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.238213    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"
Jul 28 13:30:43.238337 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.238250    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c" event={"ID":"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c","Type":"ContainerDied","Data":"4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8"}
Jul 28 13:30:43.238337 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.238305    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c" event={"ID":"73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c","Type":"ContainerDied","Data":"a0009050d746b03a241ae687eeeec24a4ee8f4b7e6ae8aaf3d4d453f3e66dc1b"}
Jul 28 13:30:43.247474 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.247446    2567 scope.go:117] "RemoveContainer" containerID="46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519"
Jul 28 13:30:43.247795 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:30:43.247771    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519\": container with ID starting with 46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519 not found: ID does not exist" containerID="46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519"
Jul 28 13:30:43.247904 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.247807    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519"} err="failed to get container status \"46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519\": rpc error: code = NotFound desc = could not find container \"46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519\": container with ID starting with 46e667d695dca7e4fbcf5804f212761a4eea1cd81ba2fafee13a8a1afb29c519 not found: ID does not exist"
Jul 28 13:30:43.247904 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.247833    2567 scope.go:117] "RemoveContainer" containerID="4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8"
Jul 28 13:30:43.257404 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.257388    2567 scope.go:117] "RemoveContainer" containerID="4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8"
Jul 28 13:30:43.257665 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:30:43.257646    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8\": container with ID starting with 4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8 not found: ID does not exist" containerID="4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8"
Jul 28 13:30:43.257745 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.257674    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8"} err="failed to get container status \"4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8\": rpc error: code = NotFound desc = could not find container \"4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8\": container with ID starting with 4354de9f563c1e97d2acb591b74978c1542976a311a5f24376b14a6482fae9c8 not found: ID does not exist"
Jul 28 13:30:43.265824 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.265799    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"]
Jul 28 13:30:43.268159 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.268101    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8b4f72-66d9968f9b-wnf6c"]
Jul 28 13:30:43.279579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.279548    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"]
Jul 28 13:30:43.284615 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.284592    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8b4f72-645d4bc97b-nr2vk"]
Jul 28 13:30:43.502705 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.502669    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49ebcb67-c4d7-421e-8e09-a52d23ebff71" path="/var/lib/kubelet/pods/49ebcb67-c4d7-421e-8e09-a52d23ebff71/volumes"
Jul 28 13:30:43.503128 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.503066    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c" path="/var/lib/kubelet/pods/73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c/volumes"
Jul 28 13:30:43.503351 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.503338    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73fea2fa-055e-410e-a1ec-b15e59104318" path="/var/lib/kubelet/pods/73fea2fa-055e-410e-a1ec-b15e59104318/volumes"
Jul 28 13:30:43.503575 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:43.503564    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6da48ea-744a-4d90-bcde-74d2b1fd7b63" path="/var/lib/kubelet/pods/c6da48ea-744a-4d90-bcde-74d2b1fd7b63/volumes"
Jul 28 13:30:49.235060 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:49.235028    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:49.335113 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:49.335064    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:49.482698 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:49.482663    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"]
Jul 28 13:30:49.482928 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:49.482891    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy" containerID="cri-o://cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a" gracePeriod=30
Jul 28 13:30:49.505274 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:49.505147    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:49.745038 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:49.744990    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:30:54.765788 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.765760    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:30:54.927376 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927340    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istiod-ca-cert\") pod \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") "
Jul 28 13:30:54.927552 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927408    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-certs\") pod \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") "
Jul 28 13:30:54.927552 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927429    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlccg\" (UniqueName: \"kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-kube-api-access-nlccg\") pod \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") "
Jul 28 13:30:54.927633 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927590    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-data\") pod \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") "
Jul 28 13:30:54.927704 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927688    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-credential-socket\") pod \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") "
Jul 28 13:30:54.927704 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927693    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" (UID: "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:30:54.927814 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927717    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-socket\") pod \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") "
Jul 28 13:30:54.927814 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927716    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" (UID: "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:30:54.927814 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927749    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-token\") pod \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") "
Jul 28 13:30:54.927814 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927793    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-envoy\") pod \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") "
Jul 28 13:30:54.928044 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927817    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-podinfo\") pod \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\" (UID: \"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b\") "
Jul 28 13:30:54.928044 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.927877    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" (UID: "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:30:54.928044 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.928011    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" (UID: "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:30:54.928208 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.928189    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istiod-ca-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:54.928262 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.928215    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:54.928262 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.928227    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-credential-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:54.928262 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.928237    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-workload-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:54.928596 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.928565    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-data" (OuterVolumeSpecName: "istio-data") pod "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" (UID: "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:30:54.930010 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.929980    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-kube-api-access-nlccg" (OuterVolumeSpecName: "kube-api-access-nlccg") pod "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" (UID: "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b"). InnerVolumeSpecName "kube-api-access-nlccg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:30:54.930121 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.930073    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-token" (OuterVolumeSpecName: "istio-token") pod "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" (UID: "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:30:54.930218 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.930189    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" (UID: "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:30:54.930337 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:54.930251    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" (UID: "09ae532d-ef78-48b4-a066-7b3b1f1d8b1b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:30:55.029686 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.029650    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-envoy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:55.029686 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.029681    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-podinfo\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:55.029686 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.029692    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlccg\" (UniqueName: \"kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-kube-api-access-nlccg\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:55.029962 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.029704    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-data\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:55.029962 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.029712    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:30:55.314877 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.314792    2567 generic.go:356] "Generic (PLEG): container finished" podID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerID="cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a" exitCode=0
Jul 28 13:30:55.314877 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.314838    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"
Jul 28 13:30:55.314877 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.314846    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" event={"ID":"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b","Type":"ContainerDied","Data":"cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a"}
Jul 28 13:30:55.315119 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.314895    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958" event={"ID":"09ae532d-ef78-48b4-a066-7b3b1f1d8b1b","Type":"ContainerDied","Data":"3e53fa8a7e728bc2343e6f994be647beffae735fb8eeb4cc0d33a9f98f74ea6b"}
Jul 28 13:30:55.315119 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.314932    2567 scope.go:117] "RemoveContainer" containerID="cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a"
Jul 28 13:30:55.324427 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.324407    2567 scope.go:117] "RemoveContainer" containerID="d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167"
Jul 28 13:30:55.334725 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.334701    2567 scope.go:117] "RemoveContainer" containerID="cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a"
Jul 28 13:30:55.335122 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:30:55.335093    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a\": container with ID starting with cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a not found: ID does not exist" containerID="cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a"
Jul 28 13:30:55.335238 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.335130    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a"} err="failed to get container status \"cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a\": rpc error: code = NotFound desc = could not find container \"cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a\": container with ID starting with cddf1497822f21913f463851b2ee6b3206ce0048603a1d3f21168c6d34445a3a not found: ID does not exist"
Jul 28 13:30:55.335238 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.335159    2567 scope.go:117] "RemoveContainer" containerID="d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167"
Jul 28 13:30:55.335465 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:30:55.335443    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167\": container with ID starting with d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167 not found: ID does not exist" containerID="d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167"
Jul 28 13:30:55.335513 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.335476    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167"} err="failed to get container status \"d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167\": rpc error: code = NotFound desc = could not find container \"d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167\": container with ID starting with d4bbd5a07055f796c406d673022c33f0407ed45db7e9bdda3be3433f479b1167 not found: ID does not exist"
Jul 28 13:30:55.338120 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.338099    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"]
Jul 28 13:30:55.342510 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.342486    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8b4f72-openshift-default-79fc966db8-xl958"]
Jul 28 13:30:55.502083 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:30:55.502050    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" path="/var/lib/kubelet/pods/09ae532d-ef78-48b4-a066-7b3b1f1d8b1b/volumes"
Jul 28 13:31:00.484313 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.484279    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww"]
Jul 28 13:31:00.486930 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.486890    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d82b76-29754090-5k8ww"]
Jul 28 13:31:00.494003 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.493978    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:00.515315 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.515276    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"]
Jul 28 13:31:00.515565 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.515536    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf" podUID="3c72bf4c-7425-45ac-8472-8f72eb1326e9" containerName="payload-processing" containerID="cri-o://9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605" gracePeriod=30
Jul 28 13:31:00.588865 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.588832    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:00.660735 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.660696    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:00.718521 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.718493    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:00.773699 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.773673    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:31:00.884659 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.884607    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwf5d\" (UniqueName: \"kubernetes.io/projected/3c72bf4c-7425-45ac-8472-8f72eb1326e9-kube-api-access-gwf5d\") pod \"3c72bf4c-7425-45ac-8472-8f72eb1326e9\" (UID: \"3c72bf4c-7425-45ac-8472-8f72eb1326e9\") "
Jul 28 13:31:00.884872 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.884696    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c72bf4c-7425-45ac-8472-8f72eb1326e9-plugins-config-volume\") pod \"3c72bf4c-7425-45ac-8472-8f72eb1326e9\" (UID: \"3c72bf4c-7425-45ac-8472-8f72eb1326e9\") "
Jul 28 13:31:00.885127 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.885103    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c72bf4c-7425-45ac-8472-8f72eb1326e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3c72bf4c-7425-45ac-8472-8f72eb1326e9" (UID: "3c72bf4c-7425-45ac-8472-8f72eb1326e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:31:00.886804 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.886783    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c72bf4c-7425-45ac-8472-8f72eb1326e9-kube-api-access-gwf5d" (OuterVolumeSpecName: "kube-api-access-gwf5d") pod "3c72bf4c-7425-45ac-8472-8f72eb1326e9" (UID: "3c72bf4c-7425-45ac-8472-8f72eb1326e9"). InnerVolumeSpecName "kube-api-access-gwf5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:31:00.985550 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.985515    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c72bf4c-7425-45ac-8472-8f72eb1326e9-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:31:00.985550 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:00.985543    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwf5d\" (UniqueName: \"kubernetes.io/projected/3c72bf4c-7425-45ac-8472-8f72eb1326e9-kube-api-access-gwf5d\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:31:01.035768 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.035737    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:01.363317 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.363225    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c72bf4c-7425-45ac-8472-8f72eb1326e9" containerID="9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605" exitCode=0
Jul 28 13:31:01.363317 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.363281    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"
Jul 28 13:31:01.363317 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.363302    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf" event={"ID":"3c72bf4c-7425-45ac-8472-8f72eb1326e9","Type":"ContainerDied","Data":"9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605"}
Jul 28 13:31:01.363564 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.363379    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf" event={"ID":"3c72bf4c-7425-45ac-8472-8f72eb1326e9","Type":"ContainerDied","Data":"a542b9fe4ca52fb3dd8a85908976c9da637258571affcf5623fe4418cc0c1070"}
Jul 28 13:31:01.363564 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.363402    2567 scope.go:117] "RemoveContainer" containerID="9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605"
Jul 28 13:31:01.374043 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.374023    2567 scope.go:117] "RemoveContainer" containerID="9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605"
Jul 28 13:31:01.374381 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:31:01.374360    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605\": container with ID starting with 9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605 not found: ID does not exist" containerID="9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605"
Jul 28 13:31:01.374434 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.374391    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605"} err="failed to get container status \"9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605\": rpc error: code = NotFound desc = could not find container \"9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605\": container with ID starting with 9860e6d4917aca20bcd213ba4988ef61a8a5e145d6ac3ace50d7845aa4d2e605 not found: ID does not exist"
Jul 28 13:31:01.387162 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.387127    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"]
Jul 28 13:31:01.390867 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.390838    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d82b76-578d79fb78-mfnwf"]
Jul 28 13:31:01.501031 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.500994    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25aa573d-f64c-49d8-ac18-b061b050e6ba" path="/var/lib/kubelet/pods/25aa573d-f64c-49d8-ac18-b061b050e6ba/volumes"
Jul 28 13:31:01.501419 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:01.501332    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c72bf4c-7425-45ac-8472-8f72eb1326e9" path="/var/lib/kubelet/pods/3c72bf4c-7425-45ac-8472-8f72eb1326e9/volumes"
Jul 28 13:31:07.301464 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:07.301425    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:07.401869 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:07.401838    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:07.588143 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:07.588009    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:07.828774 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:07.828698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:08.243268 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.243235    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:08.539209 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539163    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"]
Jul 28 13:31:08.539714 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539697    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c72bf4c-7425-45ac-8472-8f72eb1326e9" containerName="payload-processing"
Jul 28 13:31:08.539771 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539717    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c72bf4c-7425-45ac-8472-8f72eb1326e9" containerName="payload-processing"
Jul 28 13:31:08.539771 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539741    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73fea2fa-055e-410e-a1ec-b15e59104318" containerName="revoke-keys"
Jul 28 13:31:08.539771 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539750    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="73fea2fa-055e-410e-a1ec-b15e59104318" containerName="revoke-keys"
Jul 28 13:31:08.539771 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539770    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy"
Jul 28 13:31:08.539949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539779    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy"
Jul 28 13:31:08.539949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539791    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy"
Jul 28 13:31:08.539949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539800    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy"
Jul 28 13:31:08.539949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539815    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ebcb67-c4d7-421e-8e09-a52d23ebff71" containerName="payload-processing"
Jul 28 13:31:08.539949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539824    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ebcb67-c4d7-421e-8e09-a52d23ebff71" containerName="payload-processing"
Jul 28 13:31:08.539949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539835    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c" containerName="payload-pre-processing"
Jul 28 13:31:08.539949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539843    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c" containerName="payload-pre-processing"
Jul 28 13:31:08.539949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539942    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="73fea2fa-055e-410e-a1ec-b15e59104318" containerName="revoke-keys"
Jul 28 13:31:08.540240 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539954    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="49ebcb67-c4d7-421e-8e09-a52d23ebff71" containerName="payload-processing"
Jul 28 13:31:08.540240 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539963    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy"
Jul 28 13:31:08.540240 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539972    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c72bf4c-7425-45ac-8472-8f72eb1326e9" containerName="payload-processing"
Jul 28 13:31:08.540240 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.539981    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="73d5d51e-483e-4f4b-b6c3-2a0e27d7be1c" containerName="payload-pre-processing"
Jul 28 13:31:08.544713 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.544689    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.547399 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.547375    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-955728-openshift-default-dockercfg-s286h\""
Jul 28 13:31:08.553430 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.553403    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"]
Jul 28 13:31:08.567206 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.567178    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:08.656787 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.656740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-certs\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.656787 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.656790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zq27\" (UniqueName: \"kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-kube-api-access-4zq27\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.657105 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.656862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/758dbfa7-172c-4bd6-8899-d81e5dd27422-istiod-ca-cert\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.657105 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.656902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-token\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.657105 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.657002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-credential-socket\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.657105 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.657031    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-envoy\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.657105 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.657062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-podinfo\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.657105 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.657104    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-data\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.657336 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.657127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-socket\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.668756 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.668728    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:08.758292 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758256    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-socket\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.758486 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758311    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-certs\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.758486 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758329    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zq27\" (UniqueName: \"kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-kube-api-access-4zq27\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.758486 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/758dbfa7-172c-4bd6-8899-d81e5dd27422-istiod-ca-cert\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.758486 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-token\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.758486 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-credential-socket\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.758486 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-envoy\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.758799 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758585    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-podinfo\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.758799 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758671    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-data\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.758799 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758739    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-socket\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.758799 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.758758    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-certs\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.759091 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.759072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-data\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.759091 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.759078    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-credential-socket\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.759194 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.759163    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/758dbfa7-172c-4bd6-8899-d81e5dd27422-istiod-ca-cert\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.760909 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.760891    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-envoy\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.761138 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.761122    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-podinfo\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.766862 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.766835    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-token\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.766990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.766970    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zq27\" (UniqueName: \"kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-kube-api-access-4zq27\") pod \"e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") " pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.857517 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.857424    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:08.997940 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:08.997900    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"]
Jul 28 13:31:08.999532 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:31:08.999503    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod758dbfa7_172c_4bd6_8899_d81e5dd27422.slice/crio-84723aaddada87277884160ef1ce8eee1f4c305e7237fab479982d5cbd69a46a WatchSource:0}: Error finding container 84723aaddada87277884160ef1ce8eee1f4c305e7237fab479982d5cbd69a46a: Status 404 returned error can't find the container with id 84723aaddada87277884160ef1ce8eee1f4c305e7237fab479982d5cbd69a46a
Jul 28 13:31:09.001669 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:09.001637    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:31:09.001756 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:09.001701    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:31:09.001756 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:09.001730    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:31:09.418750 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:09.418713    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" event={"ID":"758dbfa7-172c-4bd6-8899-d81e5dd27422","Type":"ContainerStarted","Data":"79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576"}
Jul 28 13:31:09.418983 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:09.418768    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" event={"ID":"758dbfa7-172c-4bd6-8899-d81e5dd27422","Type":"ContainerStarted","Data":"84723aaddada87277884160ef1ce8eee1f4c305e7237fab479982d5cbd69a46a"}
Jul 28 13:31:09.445516 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:09.445448    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" podStartSLOduration=1.445426465 podStartE2EDuration="1.445426465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:31:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:31:09.443385856 +0000 UTC m=+2396.372669773" watchObservedRunningTime="2026-07-28 13:31:09.445426465 +0000 UTC m=+2396.374710383"
Jul 28 13:31:09.858122 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:09.858083    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:10.862597 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:10.862568    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:11.431812 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:11.431776    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:11.432665 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:11.432635    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:11.438724 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:11.438693    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:11.530529 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:11.530490    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:11.599645 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:11.599577    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:11.993274 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:11.993241    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:12.144432 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.144392    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"]
Jul 28 13:31:12.145656 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.145627    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="09ae532d-ef78-48b4-a066-7b3b1f1d8b1b" containerName="istio-proxy"
Jul 28 13:31:12.149972 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.149947    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:31:12.153110 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.153072    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-955728\""
Jul 28 13:31:12.155942 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.155897    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"]
Jul 28 13:31:12.188482 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.188422    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl2dp\" (UniqueName: \"kubernetes.io/projected/b11f7133-507d-427f-b444-4b8f3f51856c-kube-api-access-nl2dp\") pod \"payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g\" (UID: \"b11f7133-507d-427f-b444-4b8f3f51856c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:31:12.188662 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.188524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11f7133-507d-427f-b444-4b8f3f51856c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g\" (UID: \"b11f7133-507d-427f-b444-4b8f3f51856c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:31:12.289570 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.289529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11f7133-507d-427f-b444-4b8f3f51856c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g\" (UID: \"b11f7133-507d-427f-b444-4b8f3f51856c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:31:12.289761 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.289626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2dp\" (UniqueName: \"kubernetes.io/projected/b11f7133-507d-427f-b444-4b8f3f51856c-kube-api-access-nl2dp\") pod \"payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g\" (UID: \"b11f7133-507d-427f-b444-4b8f3f51856c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:31:12.290268 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.290246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11f7133-507d-427f-b444-4b8f3f51856c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g\" (UID: \"b11f7133-507d-427f-b444-4b8f3f51856c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:31:12.299110 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.299073    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl2dp\" (UniqueName: \"kubernetes.io/projected/b11f7133-507d-427f-b444-4b8f3f51856c-kube-api-access-nl2dp\") pod \"payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g\" (UID: \"b11f7133-507d-427f-b444-4b8f3f51856c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:31:12.323340 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.323308    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:12.429373 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.429330    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:12.463460 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.463419    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:31:12.611054 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:12.611028    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"]
Jul 28 13:31:12.613118 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:31:12.613089    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11f7133_507d_427f_b444_4b8f3f51856c.slice/crio-a5e367b596eaa04a97157c09cb14dc423e8766e79d82e06219dabe00ea8ebe94 WatchSource:0}: Error finding container a5e367b596eaa04a97157c09cb14dc423e8766e79d82e06219dabe00ea8ebe94: Status 404 returned error can't find the container with id a5e367b596eaa04a97157c09cb14dc423e8766e79d82e06219dabe00ea8ebe94
Jul 28 13:31:13.444905 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:13.444871    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g" event={"ID":"b11f7133-507d-427f-b444-4b8f3f51856c","Type":"ContainerStarted","Data":"7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24"}
Jul 28 13:31:13.445339 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:13.444945    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g" event={"ID":"b11f7133-507d-427f-b444-4b8f3f51856c","Type":"ContainerStarted","Data":"a5e367b596eaa04a97157c09cb14dc423e8766e79d82e06219dabe00ea8ebe94"}
Jul 28 13:31:13.445339 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:13.445146    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:31:13.465340 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:13.465290    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g" podStartSLOduration=1.46527316 podStartE2EDuration="1.46527316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:31:13.46334165 +0000 UTC m=+2400.392625568" watchObservedRunningTime="2026-07-28 13:31:13.46527316 +0000 UTC m=+2400.394557077"
Jul 28 13:31:24.453423 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:24.453386    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:31:26.433883 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:26.433848    2567 patch_prober.go:28] interesting pod/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 28 13:31:26.434359 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:26.433904    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 28 13:31:26.522071 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:26.522036    2567 generic.go:356] "Generic (PLEG): container finished" podID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerID="79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576" exitCode=0
Jul 28 13:31:26.522296 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:26.522113    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" event={"ID":"758dbfa7-172c-4bd6-8899-d81e5dd27422","Type":"ContainerDied","Data":"79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576"}
Jul 28 13:31:26.522586 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:26.522569    2567 scope.go:117] "RemoveContainer" containerID="79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576"
Jul 28 13:31:26.523627 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:26.523601    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:31:26.523686 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:26.523671    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:31:26.523727 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:26.523712    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:31:27.548942 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:27.548818    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" event={"ID":"758dbfa7-172c-4bd6-8899-d81e5dd27422","Type":"ContainerStarted","Data":"678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24"}
Jul 28 13:31:27.858701 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:27.858586    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:27.858935 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:27.858893    2567 patch_prober.go:28] interesting pod/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 28 13:31:27.859023 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:27.858989    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 28 13:31:28.857881 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:28.857837    2567 patch_prober.go:28] interesting pod/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 28 13:31:28.858376 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:28.857907    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 28 13:31:29.858167 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:29.858120    2567 patch_prober.go:28] interesting pod/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 28 13:31:29.858602 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:29.858189    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 28 13:31:30.858098 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:30.858060    2567 patch_prober.go:28] interesting pod/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Jul 28 13:31:30.858299 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:30.858121    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Jul 28 13:31:31.862193 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:31.862155    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:31.862605 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:31.862547    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:31.863364 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:31.863343    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:31:36.628673 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:36.628576    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:37.337112 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:37.337074    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:37.643901 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:37.643802    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:37.752206 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:37.752179    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:40.391284 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:40.391248    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:40.495061 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:40.495016    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:40.567409 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:40.567377    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:41.129863 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.129820    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:41.181941 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.181877    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"]
Jul 28 13:31:41.187231 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.187202    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:31:41.189876 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.189849    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-44e001-dockercfg-zg4rp\""
Jul 28 13:31:41.190057 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.189888    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-44e001\""
Jul 28 13:31:41.194808 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.194784    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"]
Jul 28 13:31:41.203500 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.203475    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"]
Jul 28 13:31:41.207654 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.207628    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:31:41.218655 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.218625    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"]
Jul 28 13:31:41.223268 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.223245    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:41.276873 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.276836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwvwm\" (UniqueName: \"kubernetes.io/projected/12ba8715-333e-47cd-886b-6863cbc35983-kube-api-access-dwvwm\") pod \"payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj\" (UID: \"12ba8715-333e-47cd-886b-6863cbc35983\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:31:41.277068 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.276886    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ba8715-333e-47cd-886b-6863cbc35983-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj\" (UID: \"12ba8715-333e-47cd-886b-6863cbc35983\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:31:41.365057 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.365009    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:41.378244 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.378209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ba8715-333e-47cd-886b-6863cbc35983-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj\" (UID: \"12ba8715-333e-47cd-886b-6863cbc35983\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:31:41.378404 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.378338    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzqc4\" (UniqueName: \"kubernetes.io/projected/0a3e41c8-3656-429c-a2e4-a5620fa498f2-kube-api-access-hzqc4\") pod \"payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk\" (UID: \"0a3e41c8-3656-429c-a2e4-a5620fa498f2\") " pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:31:41.378404 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.378394    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3e41c8-3656-429c-a2e4-a5620fa498f2-plugins-config-volume\") pod \"payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk\" (UID: \"0a3e41c8-3656-429c-a2e4-a5620fa498f2\") " pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:31:41.378492 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.378471    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvwm\" (UniqueName: \"kubernetes.io/projected/12ba8715-333e-47cd-886b-6863cbc35983-kube-api-access-dwvwm\") pod \"payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj\" (UID: \"12ba8715-333e-47cd-886b-6863cbc35983\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:31:41.378956 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.378940    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ba8715-333e-47cd-886b-6863cbc35983-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj\" (UID: \"12ba8715-333e-47cd-886b-6863cbc35983\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:31:41.386737 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.386648    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwvwm\" (UniqueName: \"kubernetes.io/projected/12ba8715-333e-47cd-886b-6863cbc35983-kube-api-access-dwvwm\") pod \"payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj\" (UID: \"12ba8715-333e-47cd-886b-6863cbc35983\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:31:41.479072 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.479024    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzqc4\" (UniqueName: \"kubernetes.io/projected/0a3e41c8-3656-429c-a2e4-a5620fa498f2-kube-api-access-hzqc4\") pod \"payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk\" (UID: \"0a3e41c8-3656-429c-a2e4-a5620fa498f2\") " pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:31:41.479072 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.479079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3e41c8-3656-429c-a2e4-a5620fa498f2-plugins-config-volume\") pod \"payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk\" (UID: \"0a3e41c8-3656-429c-a2e4-a5620fa498f2\") " pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:31:41.479765 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.479742    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3e41c8-3656-429c-a2e4-a5620fa498f2-plugins-config-volume\") pod \"payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk\" (UID: \"0a3e41c8-3656-429c-a2e4-a5620fa498f2\") " pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:31:41.487822 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.487785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzqc4\" (UniqueName: \"kubernetes.io/projected/0a3e41c8-3656-429c-a2e4-a5620fa498f2-kube-api-access-hzqc4\") pod \"payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk\" (UID: \"0a3e41c8-3656-429c-a2e4-a5620fa498f2\") " pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:31:41.506001 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.504390    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:31:41.520433 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.520400    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:31:41.677259 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.677228    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"]
Jul 28 13:31:41.678458 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:31:41.678416    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ba8715_333e_47cd_886b_6863cbc35983.slice/crio-3d1dc9271fdc4e96360ec35f1e4e410acc4cb175b01f70de4c9db79f1170d598 WatchSource:0}: Error finding container 3d1dc9271fdc4e96360ec35f1e4e410acc4cb175b01f70de4c9db79f1170d598: Status 404 returned error can't find the container with id 3d1dc9271fdc4e96360ec35f1e4e410acc4cb175b01f70de4c9db79f1170d598
Jul 28 13:31:41.699907 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:41.699756    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"]
Jul 28 13:31:41.703072 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:31:41.703046    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3e41c8_3656_429c_a2e4_a5620fa498f2.slice/crio-30a6b3dc368919b3c86a019e375cb6d837b5ae62be20c95c1d4c48c48212806f WatchSource:0}: Error finding container 30a6b3dc368919b3c86a019e375cb6d837b5ae62be20c95c1d4c48c48212806f: Status 404 returned error can't find the container with id 30a6b3dc368919b3c86a019e375cb6d837b5ae62be20c95c1d4c48c48212806f
Jul 28 13:31:42.643459 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:42.643418    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk" event={"ID":"0a3e41c8-3656-429c-a2e4-a5620fa498f2","Type":"ContainerStarted","Data":"d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d"}
Jul 28 13:31:42.643990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:42.643480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk" event={"ID":"0a3e41c8-3656-429c-a2e4-a5620fa498f2","Type":"ContainerStarted","Data":"30a6b3dc368919b3c86a019e375cb6d837b5ae62be20c95c1d4c48c48212806f"}
Jul 28 13:31:42.643990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:42.643628    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:31:42.645198 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:42.645173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj" event={"ID":"12ba8715-333e-47cd-886b-6863cbc35983","Type":"ContainerStarted","Data":"b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967"}
Jul 28 13:31:42.645307 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:42.645216    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:31:42.645307 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:42.645232    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj" event={"ID":"12ba8715-333e-47cd-886b-6863cbc35983","Type":"ContainerStarted","Data":"3d1dc9271fdc4e96360ec35f1e4e410acc4cb175b01f70de4c9db79f1170d598"}
Jul 28 13:31:42.660867 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:42.660813    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk" podStartSLOduration=1.6607983160000002 podStartE2EDuration="1.660798316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:31:42.659200784 +0000 UTC m=+2429.588484725" watchObservedRunningTime="2026-07-28 13:31:42.660798316 +0000 UTC m=+2429.590082233"
Jul 28 13:31:42.676989 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:42.676932    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj" podStartSLOduration=1.676902334 podStartE2EDuration="1.676902334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:31:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:31:42.674886093 +0000 UTC m=+2429.604170013" watchObservedRunningTime="2026-07-28 13:31:42.676902334 +0000 UTC m=+2429.606186251"
Jul 28 13:31:51.281483 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:51.281446    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:51.331456 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:51.331416    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:31:53.652394 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:53.652353    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:31:53.652795 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:31:53.652659    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:32:05.461847 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:05.461773    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:24.188219 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.188186    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:24.217792 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.217764    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"]
Jul 28 13:32:24.218025 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.217987    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g" podUID="b11f7133-507d-427f-b444-4b8f3f51856c" containerName="payload-pre-processing" containerID="cri-o://7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24" gracePeriod=30
Jul 28 13:32:24.248102 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.248059    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:24.348253 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.348220    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:24.478310 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.478284    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:32:24.500970 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.500842    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:24.591778 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.591737    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11f7133-507d-427f-b444-4b8f3f51856c-plugins-config-volume\") pod \"b11f7133-507d-427f-b444-4b8f3f51856c\" (UID: \"b11f7133-507d-427f-b444-4b8f3f51856c\") "
Jul 28 13:32:24.592027 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.591807    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl2dp\" (UniqueName: \"kubernetes.io/projected/b11f7133-507d-427f-b444-4b8f3f51856c-kube-api-access-nl2dp\") pod \"b11f7133-507d-427f-b444-4b8f3f51856c\" (UID: \"b11f7133-507d-427f-b444-4b8f3f51856c\") "
Jul 28 13:32:24.592216 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.592190    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b11f7133-507d-427f-b444-4b8f3f51856c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b11f7133-507d-427f-b444-4b8f3f51856c" (UID: "b11f7133-507d-427f-b444-4b8f3f51856c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:32:24.593904 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.593878    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b11f7133-507d-427f-b444-4b8f3f51856c-kube-api-access-nl2dp" (OuterVolumeSpecName: "kube-api-access-nl2dp") pod "b11f7133-507d-427f-b444-4b8f3f51856c" (UID: "b11f7133-507d-427f-b444-4b8f3f51856c"). InnerVolumeSpecName "kube-api-access-nl2dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:32:24.693135 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.693100    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b11f7133-507d-427f-b444-4b8f3f51856c-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:24.693135 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.693129    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl2dp\" (UniqueName: \"kubernetes.io/projected/b11f7133-507d-427f-b444-4b8f3f51856c-kube-api-access-nl2dp\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:24.821698 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.821647    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:24.883764 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.883730    2567 generic.go:356] "Generic (PLEG): container finished" podID="b11f7133-507d-427f-b444-4b8f3f51856c" containerID="7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24" exitCode=0
Jul 28 13:32:24.883981 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.883775    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"
Jul 28 13:32:24.883981 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.883794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g" event={"ID":"b11f7133-507d-427f-b444-4b8f3f51856c","Type":"ContainerDied","Data":"7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24"}
Jul 28 13:32:24.883981 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.883835    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g" event={"ID":"b11f7133-507d-427f-b444-4b8f3f51856c","Type":"ContainerDied","Data":"a5e367b596eaa04a97157c09cb14dc423e8766e79d82e06219dabe00ea8ebe94"}
Jul 28 13:32:24.883981 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.883857    2567 scope.go:117] "RemoveContainer" containerID="7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24"
Jul 28 13:32:24.894226 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.894208    2567 scope.go:117] "RemoveContainer" containerID="7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24"
Jul 28 13:32:24.894527 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:32:24.894503    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24\": container with ID starting with 7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24 not found: ID does not exist" containerID="7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24"
Jul 28 13:32:24.894591 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.894538    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24"} err="failed to get container status \"7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24\": rpc error: code = NotFound desc = could not find container \"7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24\": container with ID starting with 7a2dd2c314af0295f0879713e332f67a7891c648c26c09a493980b64ee733c24 not found: ID does not exist"
Jul 28 13:32:24.905647 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.905617    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"]
Jul 28 13:32:24.911484 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:24.911450    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g"]
Jul 28 13:32:25.452331 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:25.452273    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-955728-57c5fd89c6-27h6g" podUID="b11f7133-507d-427f-b444-4b8f3f51856c" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.73:9004: i/o timeout"
Jul 28 13:32:25.501601 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:25.501565    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b11f7133-507d-427f-b444-4b8f3f51856c" path="/var/lib/kubelet/pods/b11f7133-507d-427f-b444-4b8f3f51856c/volumes"
Jul 28 13:32:31.036950 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:31.036892    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:31.091586 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:31.091549    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:31.301897 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:31.301801    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"]
Jul 28 13:32:31.302164 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:31.302127    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy" containerID="cri-o://678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24" gracePeriod=30
Jul 28 13:32:31.327534 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:31.327499    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:31.554797 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:31.554715    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:31.865289 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:31.865197    2567 patch_prober.go:28] interesting pod/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 13:32:31.865289 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:31.865266    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 13:32:32.243168 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:32.243087    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:36.567267 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.567197    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:32:36.599581 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.599553    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/758dbfa7-172c-4bd6-8899-d81e5dd27422-istiod-ca-cert\") pod \"758dbfa7-172c-4bd6-8899-d81e5dd27422\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") "
Jul 28 13:32:36.599768 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.599624    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-credential-socket\") pod \"758dbfa7-172c-4bd6-8899-d81e5dd27422\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") "
Jul 28 13:32:36.599768 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.599656    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-envoy\") pod \"758dbfa7-172c-4bd6-8899-d81e5dd27422\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") "
Jul 28 13:32:36.599768 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.599682    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-socket\") pod \"758dbfa7-172c-4bd6-8899-d81e5dd27422\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") "
Jul 28 13:32:36.599768 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.599710    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-token\") pod \"758dbfa7-172c-4bd6-8899-d81e5dd27422\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") "
Jul 28 13:32:36.599768 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.599737    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zq27\" (UniqueName: \"kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-kube-api-access-4zq27\") pod \"758dbfa7-172c-4bd6-8899-d81e5dd27422\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") "
Jul 28 13:32:36.600081 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.599793    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-data\") pod \"758dbfa7-172c-4bd6-8899-d81e5dd27422\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") "
Jul 28 13:32:36.600081 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.599954    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "758dbfa7-172c-4bd6-8899-d81e5dd27422" (UID: "758dbfa7-172c-4bd6-8899-d81e5dd27422"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:32:36.600081 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.599998    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "758dbfa7-172c-4bd6-8899-d81e5dd27422" (UID: "758dbfa7-172c-4bd6-8899-d81e5dd27422"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:32:36.600081 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.600045    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-certs\") pod \"758dbfa7-172c-4bd6-8899-d81e5dd27422\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") "
Jul 28 13:32:36.600345 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.600085    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-podinfo\") pod \"758dbfa7-172c-4bd6-8899-d81e5dd27422\" (UID: \"758dbfa7-172c-4bd6-8899-d81e5dd27422\") "
Jul 28 13:32:36.600345 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.600118    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/758dbfa7-172c-4bd6-8899-d81e5dd27422-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "758dbfa7-172c-4bd6-8899-d81e5dd27422" (UID: "758dbfa7-172c-4bd6-8899-d81e5dd27422"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:32:36.600345 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.600298    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "758dbfa7-172c-4bd6-8899-d81e5dd27422" (UID: "758dbfa7-172c-4bd6-8899-d81e5dd27422"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:32:36.600501 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.600440    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:36.600501 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.600456    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/758dbfa7-172c-4bd6-8899-d81e5dd27422-istiod-ca-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:36.600501 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.600469    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-credential-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:36.600501 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.600482    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-workload-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:36.600727 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.600706    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-data" (OuterVolumeSpecName: "istio-data") pod "758dbfa7-172c-4bd6-8899-d81e5dd27422" (UID: "758dbfa7-172c-4bd6-8899-d81e5dd27422"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:32:36.602436 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.602398    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "758dbfa7-172c-4bd6-8899-d81e5dd27422" (UID: "758dbfa7-172c-4bd6-8899-d81e5dd27422"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:32:36.602559 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.602469    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-token" (OuterVolumeSpecName: "istio-token") pod "758dbfa7-172c-4bd6-8899-d81e5dd27422" (UID: "758dbfa7-172c-4bd6-8899-d81e5dd27422"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:32:36.602559 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.602474    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "758dbfa7-172c-4bd6-8899-d81e5dd27422" (UID: "758dbfa7-172c-4bd6-8899-d81e5dd27422"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:32:36.602559 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.602496    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-kube-api-access-4zq27" (OuterVolumeSpecName: "kube-api-access-4zq27") pod "758dbfa7-172c-4bd6-8899-d81e5dd27422" (UID: "758dbfa7-172c-4bd6-8899-d81e5dd27422"). InnerVolumeSpecName "kube-api-access-4zq27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:32:36.701103 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.701063    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-envoy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:36.701103 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.701093    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:36.701103 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.701102    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zq27\" (UniqueName: \"kubernetes.io/projected/758dbfa7-172c-4bd6-8899-d81e5dd27422-kube-api-access-4zq27\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:36.701103 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.701117    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-data\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:36.701398 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.701138    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/758dbfa7-172c-4bd6-8899-d81e5dd27422-istio-podinfo\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:36.960224 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.960136    2567 generic.go:356] "Generic (PLEG): container finished" podID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerID="678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24" exitCode=0
Jul 28 13:32:36.960224 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.960187    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"
Jul 28 13:32:36.960404 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.960223    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" event={"ID":"758dbfa7-172c-4bd6-8899-d81e5dd27422","Type":"ContainerDied","Data":"678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24"}
Jul 28 13:32:36.960404 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.960315    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f" event={"ID":"758dbfa7-172c-4bd6-8899-d81e5dd27422","Type":"ContainerDied","Data":"84723aaddada87277884160ef1ce8eee1f4c305e7237fab479982d5cbd69a46a"}
Jul 28 13:32:36.960404 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.960349    2567 scope.go:117] "RemoveContainer" containerID="678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24"
Jul 28 13:32:36.969961 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.969939    2567 scope.go:117] "RemoveContainer" containerID="79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576"
Jul 28 13:32:36.979088 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.979071    2567 scope.go:117] "RemoveContainer" containerID="678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24"
Jul 28 13:32:36.979378 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:32:36.979359    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24\": container with ID starting with 678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24 not found: ID does not exist" containerID="678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24"
Jul 28 13:32:36.979433 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.979387    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24"} err="failed to get container status \"678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24\": rpc error: code = NotFound desc = could not find container \"678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24\": container with ID starting with 678854bbeca3b286924e756342f990b2eb92f6b6fe9075f65c4994dae0b17b24 not found: ID does not exist"
Jul 28 13:32:36.979433 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.979405    2567 scope.go:117] "RemoveContainer" containerID="79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576"
Jul 28 13:32:36.979641 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:32:36.979624    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576\": container with ID starting with 79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576 not found: ID does not exist" containerID="79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576"
Jul 28 13:32:36.979682 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.979645    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576"} err="failed to get container status \"79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576\": rpc error: code = NotFound desc = could not find container \"79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576\": container with ID starting with 79ecd6973767c78853c14c9ddbe32851cf4878e3e289877b20cc6ed0231cc576 not found: ID does not exist"
Jul 28 13:32:36.988480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.988459    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"]
Jul 28 13:32:36.990731 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:36.990711    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-955728-openshift-default-bfb96d45b-xkr7f"]
Jul 28 13:32:37.502303 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:37.502274    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" path="/var/lib/kubelet/pods/758dbfa7-172c-4bd6-8899-d81e5dd27422/volumes"
Jul 28 13:32:47.152166 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.152126    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:47.172105 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.172075    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"]
Jul 28 13:32:47.172288 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.172271    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk" podUID="0a3e41c8-3656-429c-a2e4-a5620fa498f2" containerName="payload-processing" containerID="cri-o://d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d" gracePeriod=30
Jul 28 13:32:47.180388 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.179992    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"]
Jul 28 13:32:47.180388 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.180234    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj" podUID="12ba8715-333e-47cd-886b-6863cbc35983" containerName="payload-pre-processing" containerID="cri-o://b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967" gracePeriod=30
Jul 28 13:32:47.443358 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.443330    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:32:47.471965 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.471939    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:32:47.497993 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.497967    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzqc4\" (UniqueName: \"kubernetes.io/projected/0a3e41c8-3656-429c-a2e4-a5620fa498f2-kube-api-access-hzqc4\") pod \"0a3e41c8-3656-429c-a2e4-a5620fa498f2\" (UID: \"0a3e41c8-3656-429c-a2e4-a5620fa498f2\") "
Jul 28 13:32:47.498197 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.498014    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3e41c8-3656-429c-a2e4-a5620fa498f2-plugins-config-volume\") pod \"0a3e41c8-3656-429c-a2e4-a5620fa498f2\" (UID: \"0a3e41c8-3656-429c-a2e4-a5620fa498f2\") "
Jul 28 13:32:47.498381 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.498359    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a3e41c8-3656-429c-a2e4-a5620fa498f2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a3e41c8-3656-429c-a2e4-a5620fa498f2" (UID: "0a3e41c8-3656-429c-a2e4-a5620fa498f2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:32:47.500207 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.500178    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a3e41c8-3656-429c-a2e4-a5620fa498f2-kube-api-access-hzqc4" (OuterVolumeSpecName: "kube-api-access-hzqc4") pod "0a3e41c8-3656-429c-a2e4-a5620fa498f2" (UID: "0a3e41c8-3656-429c-a2e4-a5620fa498f2"). InnerVolumeSpecName "kube-api-access-hzqc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:32:47.599212 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.599181    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwvwm\" (UniqueName: \"kubernetes.io/projected/12ba8715-333e-47cd-886b-6863cbc35983-kube-api-access-dwvwm\") pod \"12ba8715-333e-47cd-886b-6863cbc35983\" (UID: \"12ba8715-333e-47cd-886b-6863cbc35983\") "
Jul 28 13:32:47.599212 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.599223    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ba8715-333e-47cd-886b-6863cbc35983-plugins-config-volume\") pod \"12ba8715-333e-47cd-886b-6863cbc35983\" (UID: \"12ba8715-333e-47cd-886b-6863cbc35983\") "
Jul 28 13:32:47.599490 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.599463    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzqc4\" (UniqueName: \"kubernetes.io/projected/0a3e41c8-3656-429c-a2e4-a5620fa498f2-kube-api-access-hzqc4\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:47.599490 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.599484    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a3e41c8-3656-429c-a2e4-a5620fa498f2-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:47.599680 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.599599    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12ba8715-333e-47cd-886b-6863cbc35983-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "12ba8715-333e-47cd-886b-6863cbc35983" (UID: "12ba8715-333e-47cd-886b-6863cbc35983"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:32:47.601340 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.601319    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12ba8715-333e-47cd-886b-6863cbc35983-kube-api-access-dwvwm" (OuterVolumeSpecName: "kube-api-access-dwvwm") pod "12ba8715-333e-47cd-886b-6863cbc35983" (UID: "12ba8715-333e-47cd-886b-6863cbc35983"). InnerVolumeSpecName "kube-api-access-dwvwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:32:47.700504 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.700400    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwvwm\" (UniqueName: \"kubernetes.io/projected/12ba8715-333e-47cd-886b-6863cbc35983-kube-api-access-dwvwm\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:47.700504 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:47.700444    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ba8715-333e-47cd-886b-6863cbc35983-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:32:48.025099 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.025066    2567 generic.go:356] "Generic (PLEG): container finished" podID="0a3e41c8-3656-429c-a2e4-a5620fa498f2" containerID="d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d" exitCode=0
Jul 28 13:32:48.025283 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.025138    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"
Jul 28 13:32:48.025283 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.025154    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk" event={"ID":"0a3e41c8-3656-429c-a2e4-a5620fa498f2","Type":"ContainerDied","Data":"d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d"}
Jul 28 13:32:48.025283 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.025212    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk" event={"ID":"0a3e41c8-3656-429c-a2e4-a5620fa498f2","Type":"ContainerDied","Data":"30a6b3dc368919b3c86a019e375cb6d837b5ae62be20c95c1d4c48c48212806f"}
Jul 28 13:32:48.025283 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.025245    2567 scope.go:117] "RemoveContainer" containerID="d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d"
Jul 28 13:32:48.026741 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.026717    2567 generic.go:356] "Generic (PLEG): container finished" podID="12ba8715-333e-47cd-886b-6863cbc35983" containerID="b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967" exitCode=0
Jul 28 13:32:48.026860 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.026798    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"
Jul 28 13:32:48.026860 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.026810    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj" event={"ID":"12ba8715-333e-47cd-886b-6863cbc35983","Type":"ContainerDied","Data":"b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967"}
Jul 28 13:32:48.027010 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.026872    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj" event={"ID":"12ba8715-333e-47cd-886b-6863cbc35983","Type":"ContainerDied","Data":"3d1dc9271fdc4e96360ec35f1e4e410acc4cb175b01f70de4c9db79f1170d598"}
Jul 28 13:32:48.037861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.037838    2567 scope.go:117] "RemoveContainer" containerID="d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d"
Jul 28 13:32:48.038236 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:32:48.038213    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d\": container with ID starting with d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d not found: ID does not exist" containerID="d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d"
Jul 28 13:32:48.038331 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.038244    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d"} err="failed to get container status \"d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d\": rpc error: code = NotFound desc = could not find container \"d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d\": container with ID starting with d75185c0e04789a5771891b8e9d94363655cb312ced68b8bd41918f6a3ad002d not found: ID does not exist"
Jul 28 13:32:48.038331 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.038262    2567 scope.go:117] "RemoveContainer" containerID="b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967"
Jul 28 13:32:48.044557 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.044536    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"]
Jul 28 13:32:48.046937 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.046902    2567 scope.go:117] "RemoveContainer" containerID="b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967"
Jul 28 13:32:48.047276 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:32:48.047243    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967\": container with ID starting with b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967 not found: ID does not exist" containerID="b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967"
Jul 28 13:32:48.047399 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.047283    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967"} err="failed to get container status \"b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967\": rpc error: code = NotFound desc = could not find container \"b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967\": container with ID starting with b61e7b16ee13de651671d41f979cbd5392758c512433fe90dc8ebbcb26a30967 not found: ID does not exist"
Jul 28 13:32:48.050031 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.050011    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44e001-5b5cf4bcdb-pfklk"]
Jul 28 13:32:48.066661 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.066637    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"]
Jul 28 13:32:48.070812 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.070790    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-44e001-6785965fc6-dsflj"]
Jul 28 13:32:48.631296 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:48.631253    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:49.500934 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:49.500883    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a3e41c8-3656-429c-a2e4-a5620fa498f2" path="/var/lib/kubelet/pods/0a3e41c8-3656-429c-a2e4-a5620fa498f2/volumes"
Jul 28 13:32:49.501295 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:49.501281    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12ba8715-333e-47cd-886b-6863cbc35983" path="/var/lib/kubelet/pods/12ba8715-333e-47cd-886b-6863cbc35983/volumes"
Jul 28 13:32:53.782997 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:53.782893    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:53.898677 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:53.898635    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:54.052584 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.052486    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:54.269194 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.269154    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:54.606835 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.606801    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:54.906081 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.905990    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"]
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906366    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b11f7133-507d-427f-b444-4b8f3f51856c" containerName="payload-pre-processing"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906379    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b11f7133-507d-427f-b444-4b8f3f51856c" containerName="payload-pre-processing"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906388    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3e41c8-3656-429c-a2e4-a5620fa498f2" containerName="payload-processing"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906395    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3e41c8-3656-429c-a2e4-a5620fa498f2" containerName="payload-processing"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906406    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ba8715-333e-47cd-886b-6863cbc35983" containerName="payload-pre-processing"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906411    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ba8715-333e-47cd-886b-6863cbc35983" containerName="payload-pre-processing"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906419    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906424    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906485    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="12ba8715-333e-47cd-886b-6863cbc35983" containerName="payload-pre-processing"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906493    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a3e41c8-3656-429c-a2e4-a5620fa498f2" containerName="payload-processing"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906501    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy"
Jul 28 13:32:54.906527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.906506    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b11f7133-507d-427f-b444-4b8f3f51856c" containerName="payload-pre-processing"
Jul 28 13:32:54.909538 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.909520    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:54.912081 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.912057    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-2c9e23-openshift-default-dockercfg-djhql\""
Jul 28 13:32:54.920400 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.920374    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"]
Jul 28 13:32:54.947191 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.947147    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:54.973466 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.973433    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txzpb\" (UniqueName: \"kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-kube-api-access-txzpb\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:54.973656 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.973476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-credential-socket\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:54.973656 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.973503    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-socket\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:54.973656 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.973586    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36b19614-dd11-478a-8da1-53099bec8de5-istiod-ca-cert\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:54.973656 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.973634    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-certs\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:54.973861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.973661    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36b19614-dd11-478a-8da1-53099bec8de5-istio-podinfo\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:54.973861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.973701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-istio-token\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:54.973861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.973779    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-envoy\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:54.973861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:54.973817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-data\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.075343 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.075305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzpb\" (UniqueName: \"kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-kube-api-access-txzpb\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.075634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.075353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-credential-socket\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.075634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.075386    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-socket\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.075634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.075415    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36b19614-dd11-478a-8da1-53099bec8de5-istiod-ca-cert\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.075634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.075456    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-certs\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.075634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.075482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36b19614-dd11-478a-8da1-53099bec8de5-istio-podinfo\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.075634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.075525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-istio-token\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.075634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.075561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-envoy\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.075634 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.075587    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-data\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.076085 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.076008    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-credential-socket\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.076085 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.076033    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-data\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.076282 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.076263    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-socket\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.076379 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.076333    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-certs\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.076459 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.076433    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36b19614-dd11-478a-8da1-53099bec8de5-istiod-ca-cert\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.077893 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.077874    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-envoy\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.078162 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.078144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36b19614-dd11-478a-8da1-53099bec8de5-istio-podinfo\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.083909 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.083885    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-istio-token\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.084026 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.084002    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txzpb\" (UniqueName: \"kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-kube-api-access-txzpb\") pod \"e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") " pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.136396 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.136347    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:55.221433 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.221334    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:55.369190 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.369155    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"]
Jul 28 13:32:55.369589 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:32:55.369560    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b19614_dd11_478a_8da1_53099bec8de5.slice/crio-c086e086b9deaf8b7a256191f6cc3cdec6f6e82fba63dde9e3b4eb8ff5a8e4f5 WatchSource:0}: Error finding container c086e086b9deaf8b7a256191f6cc3cdec6f6e82fba63dde9e3b4eb8ff5a8e4f5: Status 404 returned error can't find the container with id c086e086b9deaf8b7a256191f6cc3cdec6f6e82fba63dde9e3b4eb8ff5a8e4f5
Jul 28 13:32:55.371773 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.371731    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:32:55.371858 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.371823    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:32:55.371896 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:55.371863    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:32:56.080986 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:56.080947    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" event={"ID":"36b19614-dd11-478a-8da1-53099bec8de5","Type":"ContainerStarted","Data":"77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e"}
Jul 28 13:32:56.081425 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:56.081006    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" event={"ID":"36b19614-dd11-478a-8da1-53099bec8de5","Type":"ContainerStarted","Data":"c086e086b9deaf8b7a256191f6cc3cdec6f6e82fba63dde9e3b4eb8ff5a8e4f5"}
Jul 28 13:32:56.103807 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:56.103750    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" podStartSLOduration=2.1037316 podStartE2EDuration="2.1037316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:32:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:32:56.100734412 +0000 UTC m=+2503.030018331" watchObservedRunningTime="2026-07-28 13:32:56.1037316 +0000 UTC m=+2503.033015517"
Jul 28 13:32:56.222105 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:56.222072    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:56.227082 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:56.227055    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:57.087287 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:57.087260    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:57.088357 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:57.088336    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:32:58.020679 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.020632    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:58.120788 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.120751    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:58.210796 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.210763    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:58.682953 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.682877    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:58.792668 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.792637    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:58.893450 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.893418    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:32:58.901571 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.901537    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"]
Jul 28 13:32:58.902030 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.902011    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy"
Jul 28 13:32:58.902030 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.902030    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy"
Jul 28 13:32:58.902206 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.902158    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="758dbfa7-172c-4bd6-8899-d81e5dd27422" containerName="istio-proxy"
Jul 28 13:32:58.905436 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.905414    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:32:58.908220 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.908201    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-2c9e23\""
Jul 28 13:32:58.908341 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.908247    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-2c9e23-dockercfg-59slm\""
Jul 28 13:32:58.915857 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.915834    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"]
Jul 28 13:32:58.940416 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.940330    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"]
Jul 28 13:32:58.944641 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.944617    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:32:58.951249 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:58.951218    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"]
Jul 28 13:32:59.013205 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.013163    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fx6s\" (UniqueName: \"kubernetes.io/projected/7a375373-7d92-49bd-a89d-e1250166d186-kube-api-access-7fx6s\") pod \"payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th\" (UID: \"7a375373-7d92-49bd-a89d-e1250166d186\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:32:59.013422 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.013273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42f057d9-9ea7-41d9-879d-8c84255f4177-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx\" (UID: \"42f057d9-9ea7-41d9-879d-8c84255f4177\") " pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:32:59.013422 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.013335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a375373-7d92-49bd-a89d-e1250166d186-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th\" (UID: \"7a375373-7d92-49bd-a89d-e1250166d186\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:32:59.013422 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.013420    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ktjh\" (UniqueName: \"kubernetes.io/projected/42f057d9-9ea7-41d9-879d-8c84255f4177-kube-api-access-9ktjh\") pod \"payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx\" (UID: \"42f057d9-9ea7-41d9-879d-8c84255f4177\") " pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:32:59.114689 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.114651    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ktjh\" (UniqueName: \"kubernetes.io/projected/42f057d9-9ea7-41d9-879d-8c84255f4177-kube-api-access-9ktjh\") pod \"payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx\" (UID: \"42f057d9-9ea7-41d9-879d-8c84255f4177\") " pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:32:59.114872 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.114712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fx6s\" (UniqueName: \"kubernetes.io/projected/7a375373-7d92-49bd-a89d-e1250166d186-kube-api-access-7fx6s\") pod \"payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th\" (UID: \"7a375373-7d92-49bd-a89d-e1250166d186\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:32:59.114872 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.114736    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42f057d9-9ea7-41d9-879d-8c84255f4177-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx\" (UID: \"42f057d9-9ea7-41d9-879d-8c84255f4177\") " pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:32:59.114872 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.114778    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a375373-7d92-49bd-a89d-e1250166d186-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th\" (UID: \"7a375373-7d92-49bd-a89d-e1250166d186\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:32:59.115714 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.115690    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42f057d9-9ea7-41d9-879d-8c84255f4177-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx\" (UID: \"42f057d9-9ea7-41d9-879d-8c84255f4177\") " pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:32:59.115757 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.115690    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a375373-7d92-49bd-a89d-e1250166d186-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th\" (UID: \"7a375373-7d92-49bd-a89d-e1250166d186\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:32:59.124668 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.124628    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ktjh\" (UniqueName: \"kubernetes.io/projected/42f057d9-9ea7-41d9-879d-8c84255f4177-kube-api-access-9ktjh\") pod \"payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx\" (UID: \"42f057d9-9ea7-41d9-879d-8c84255f4177\") " pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:32:59.125037 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.124676    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fx6s\" (UniqueName: \"kubernetes.io/projected/7a375373-7d92-49bd-a89d-e1250166d186-kube-api-access-7fx6s\") pod \"payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th\" (UID: \"7a375373-7d92-49bd-a89d-e1250166d186\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:32:59.217357 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.217260    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:32:59.257083 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.257046    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:32:59.379135 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.379103    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"]
Jul 28 13:32:59.379887 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:32:59.379846    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a375373_7d92_49bd_a89d_e1250166d186.slice/crio-557b1e73819d35f88681205aa642058f35380b230fabda5f3a3a8684c676e2a8 WatchSource:0}: Error finding container 557b1e73819d35f88681205aa642058f35380b230fabda5f3a3a8684c676e2a8: Status 404 returned error can't find the container with id 557b1e73819d35f88681205aa642058f35380b230fabda5f3a3a8684c676e2a8
Jul 28 13:32:59.418983 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:32:59.418955    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"]
Jul 28 13:32:59.420127 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:32:59.420100    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42f057d9_9ea7_41d9_879d_8c84255f4177.slice/crio-e1cd10fb7cc2a7284fab5f28f8d27492cdc476bbd7821659a358bec3b2d61339 WatchSource:0}: Error finding container e1cd10fb7cc2a7284fab5f28f8d27492cdc476bbd7821659a358bec3b2d61339: Status 404 returned error can't find the container with id e1cd10fb7cc2a7284fab5f28f8d27492cdc476bbd7821659a358bec3b2d61339
Jul 28 13:33:00.107843 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:00.107807    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th" event={"ID":"7a375373-7d92-49bd-a89d-e1250166d186","Type":"ContainerStarted","Data":"d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8"}
Jul 28 13:33:00.108088 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:00.107868    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th" event={"ID":"7a375373-7d92-49bd-a89d-e1250166d186","Type":"ContainerStarted","Data":"557b1e73819d35f88681205aa642058f35380b230fabda5f3a3a8684c676e2a8"}
Jul 28 13:33:00.108088 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:00.107895    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:33:00.109506 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:00.109472    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx" event={"ID":"42f057d9-9ea7-41d9-879d-8c84255f4177","Type":"ContainerStarted","Data":"e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44"}
Jul 28 13:33:00.109619 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:00.109529    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx" event={"ID":"42f057d9-9ea7-41d9-879d-8c84255f4177","Type":"ContainerStarted","Data":"e1cd10fb7cc2a7284fab5f28f8d27492cdc476bbd7821659a358bec3b2d61339"}
Jul 28 13:33:00.109619 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:00.109558    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:33:00.125876 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:00.125823    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th" podStartSLOduration=2.125801103 podStartE2EDuration="2.125801103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:33:00.124822613 +0000 UTC m=+2507.054106543" watchObservedRunningTime="2026-07-28 13:33:00.125801103 +0000 UTC m=+2507.055085020"
Jul 28 13:33:00.141465 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:00.141409    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx" podStartSLOduration=2.141389612 podStartE2EDuration="2.141389612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:33:00.139796552 +0000 UTC m=+2507.069080475" watchObservedRunningTime="2026-07-28 13:33:00.141389612 +0000 UTC m=+2507.070673529"
Jul 28 13:33:11.117550 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:11.117517    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:33:11.117972 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:11.117707    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:33:12.426399 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:12.425553    2567 patch_prober.go:28] interesting pod/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": read tcp 10.133.0.2:46024->10.133.0.76:15021: read: connection reset by peer" start-of-body=
Jul 28 13:33:12.426399 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:12.425634    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": read tcp 10.133.0.2:46024->10.133.0.76:15021: read: connection reset by peer"
Jul 28 13:33:13.194292 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:13.194257    2567 generic.go:356] "Generic (PLEG): container finished" podID="36b19614-dd11-478a-8da1-53099bec8de5" containerID="77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e" exitCode=0
Jul 28 13:33:13.194480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:13.194329    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" event={"ID":"36b19614-dd11-478a-8da1-53099bec8de5","Type":"ContainerDied","Data":"77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e"}
Jul 28 13:33:13.194723 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:13.194709    2567 scope.go:117] "RemoveContainer" containerID="77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e"
Jul 28 13:33:13.195794 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:13.195770    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:33:13.195857 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:13.195833    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:33:13.195897 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:13.195865    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:33:14.202533 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:14.202442    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" event={"ID":"36b19614-dd11-478a-8da1-53099bec8de5","Type":"ContainerStarted","Data":"523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001"}
Jul 28 13:33:14.222225 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:14.222183    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:33:14.222466 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:14.222437    2567 patch_prober.go:28] interesting pod/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 28 13:33:14.222552 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:14.222497    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 28 13:33:15.222568 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:15.222526    2567 patch_prober.go:28] interesting pod/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 28 13:33:15.223083 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:15.222591    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 28 13:33:16.222188 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:16.222148    2567 patch_prober.go:28] interesting pod/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 28 13:33:16.222375 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:16.222208    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 28 13:33:17.222731 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:17.222695    2567 patch_prober.go:28] interesting pod/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 28 13:33:17.223181 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:17.222751    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 28 13:33:18.222346 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:18.222310    2567 patch_prober.go:28] interesting pod/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Jul 28 13:33:18.222566 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:18.222374    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Jul 28 13:33:19.225906 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:19.225877    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:33:19.226405 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:19.226163    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:33:19.227145 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:19.227127    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:33:23.018381 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:23.018347    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:33:24.357649 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:24.357614    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:33:24.681895 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:24.681786    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:33:25.109381 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:25.109343    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:33:27.957874 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:27.957841    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:33:28.029499 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.029455    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:33:28.091606 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.091574    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:33:28.300440 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.300406    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:33:28.680350 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.680261    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:33:28.806663 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.806635    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:33:28.956654 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.956576    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"]
Jul 28 13:33:28.960264 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.960248    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:33:28.962832 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.962806    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-8fd168\""
Jul 28 13:33:28.962970 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.962899    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-8fd168-dockercfg-m2dx7\""
Jul 28 13:33:28.969910 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.969885    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"]
Jul 28 13:33:28.994158 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.994114    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1c3111d-2256-4b41-84d9-f43bbb26bab7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k\" (UID: \"d1c3111d-2256-4b41-84d9-f43bbb26bab7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:33:28.994328 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:28.994218    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8wx\" (UniqueName: \"kubernetes.io/projected/d1c3111d-2256-4b41-84d9-f43bbb26bab7-kube-api-access-rl8wx\") pod \"payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k\" (UID: \"d1c3111d-2256-4b41-84d9-f43bbb26bab7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:33:29.094658 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:29.094615    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1c3111d-2256-4b41-84d9-f43bbb26bab7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k\" (UID: \"d1c3111d-2256-4b41-84d9-f43bbb26bab7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:33:29.094814 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:29.094698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8wx\" (UniqueName: \"kubernetes.io/projected/d1c3111d-2256-4b41-84d9-f43bbb26bab7-kube-api-access-rl8wx\") pod \"payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k\" (UID: \"d1c3111d-2256-4b41-84d9-f43bbb26bab7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:33:29.095658 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:29.095632    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1c3111d-2256-4b41-84d9-f43bbb26bab7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k\" (UID: \"d1c3111d-2256-4b41-84d9-f43bbb26bab7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:33:29.105442 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:29.105416    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8wx\" (UniqueName: \"kubernetes.io/projected/d1c3111d-2256-4b41-84d9-f43bbb26bab7-kube-api-access-rl8wx\") pod \"payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k\" (UID: \"d1c3111d-2256-4b41-84d9-f43bbb26bab7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:33:29.272371 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:29.272328    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:33:29.421240 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:29.421214    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"]
Jul 28 13:33:29.424126 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:33:29.424098    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1c3111d_2256_4b41_84d9_f43bbb26bab7.slice/crio-04c5d5c2e02586b793f6c5a3d29165e7fee0dd51c3a9d4dc2ed3eb975bc60e4a WatchSource:0}: Error finding container 04c5d5c2e02586b793f6c5a3d29165e7fee0dd51c3a9d4dc2ed3eb975bc60e4a: Status 404 returned error can't find the container with id 04c5d5c2e02586b793f6c5a3d29165e7fee0dd51c3a9d4dc2ed3eb975bc60e4a
Jul 28 13:33:30.298843 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:30.298803    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k" event={"ID":"d1c3111d-2256-4b41-84d9-f43bbb26bab7","Type":"ContainerStarted","Data":"23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e"}
Jul 28 13:33:30.299269 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:30.298854    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k" event={"ID":"d1c3111d-2256-4b41-84d9-f43bbb26bab7","Type":"ContainerStarted","Data":"04c5d5c2e02586b793f6c5a3d29165e7fee0dd51c3a9d4dc2ed3eb975bc60e4a"}
Jul 28 13:33:30.299269 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:30.298964    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:33:30.318140 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:30.318085    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k" podStartSLOduration=2.318069582 podStartE2EDuration="2.318069582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:33:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:33:30.316985005 +0000 UTC m=+2537.246268921" watchObservedRunningTime="2026-07-28 13:33:30.318069582 +0000 UTC m=+2537.247353500"
Jul 28 13:33:41.307132 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:41.307099    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:33:53.066736 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:33:53.066697    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:34:21.631805 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:34:21.631761    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:34:25.561317 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:34:25.561284    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:34:42.803890 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:34:42.803807    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:35:14.666030 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:35:14.665990    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:35:30.920287 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:35:30.920248    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:36:13.918084 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:36:13.917993    2567 scope.go:117] "RemoveContainer" containerID="f12417d1468b9aa86cfb4adb5e5e293432c2f050317d0feecb8146b9420a6d0d"
Jul 28 13:36:13.927053 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:36:13.927032    2567 scope.go:117] "RemoveContainer" containerID="8b1e73023965f154ea717f2b9cb7db18c15ff74b912e2ea99cdc5e603365a8fc"
Jul 28 13:37:13.953467 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:37:13.953434    2567 scope.go:117] "RemoveContainer" containerID="cc27461d7c8ec77a452392506d0e8bfbe9e40232a2452ce364d7e8f119540711"
Jul 28 13:38:19.970493 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:38:19.970422    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:39:30.990334 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:30.990298    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:39:31.902398 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:31.902357    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:39:39.003807 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.003764    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"]
Jul 28 13:39:39.007368 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.007346    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.010247 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.010223    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2c9e23\"/\"kube-root-ca.crt\""
Jul 28 13:39:39.025364 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.025335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-model-cache\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.025515 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.025370    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j96nn\" (UniqueName: \"kubernetes.io/projected/339f306f-c087-49df-bd5f-460b0537403a-kube-api-access-j96nn\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.025515 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.025449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-tmp-dir\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.025515 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.025508    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-dshm\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.025725 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.025540    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339f306f-c087-49df-bd5f-460b0537403a-tls-certs\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.025725 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.025589    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-home\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.040982 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.040952    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2c9e23\"/\"default-dockercfg-5h6lt\""
Jul 28 13:39:39.041193 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.040997    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2c9e23\"/\"openshift-service-ca.crt\""
Jul 28 13:39:39.041193 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.040961    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2c9e23\"/\"sub-test-model-2c9e23-kserve-self-signed-certs\""
Jul 28 13:39:39.043767 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.043742    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"]
Jul 28 13:39:39.127128 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.127087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-tmp-dir\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.127326 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.127146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-dshm\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.127326 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.127291    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339f306f-c087-49df-bd5f-460b0537403a-tls-certs\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.127326 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.127315    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-home\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.127504 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.127451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-model-cache\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.127504 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.127477    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j96nn\" (UniqueName: \"kubernetes.io/projected/339f306f-c087-49df-bd5f-460b0537403a-kube-api-access-j96nn\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.127609 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.127544    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-tmp-dir\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.127699 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.127679    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-home\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.127858 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.127837    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-model-cache\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.129592 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.129568    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-dshm\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.130074 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.130056    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339f306f-c087-49df-bd5f-460b0537403a-tls-certs\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.148141 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.148105    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j96nn\" (UniqueName: \"kubernetes.io/projected/339f306f-c087-49df-bd5f-460b0537403a-kube-api-access-j96nn\") pod \"sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") " pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.203684 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.203643    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:39:39.316597 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.316553    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:39.467649 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:39.467620    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"]
Jul 28 13:39:39.468498 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:39:39.468468    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod339f306f_c087_49df_bd5f_460b0537403a.slice/crio-3bfaf38c66f8289418ce2fca2641b6a4f3ebba3224bb326689d689d31fbc17a6 WatchSource:0}: Error finding container 3bfaf38c66f8289418ce2fca2641b6a4f3ebba3224bb326689d689d31fbc17a6: Status 404 returned error can't find the container with id 3bfaf38c66f8289418ce2fca2641b6a4f3ebba3224bb326689d689d31fbc17a6
Jul 28 13:39:40.445937 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:40.445884    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v" event={"ID":"339f306f-c087-49df-bd5f-460b0537403a","Type":"ContainerStarted","Data":"2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03"}
Jul 28 13:39:40.446390 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:40.445964    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v" event={"ID":"339f306f-c087-49df-bd5f-460b0537403a","Type":"ContainerStarted","Data":"3bfaf38c66f8289418ce2fca2641b6a4f3ebba3224bb326689d689d31fbc17a6"}
Jul 28 13:39:40.467693 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:40.467634    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v" podStartSLOduration=2.467617634 podStartE2EDuration="2.467617634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:39:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:39:40.466112661 +0000 UTC m=+2907.395396577" watchObservedRunningTime="2026-07-28 13:39:40.467617634 +0000 UTC m=+2907.396901551"
Jul 28 13:39:49.316973 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:49.316913    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:49.317416 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:49.316995    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:49.330066 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:49.330033    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:39:49.507479 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:39:49.507445    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:40:01.680302 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:40:01.680264    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:40:58.653710 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:40:58.653676    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:40:58.749471 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:40:58.749442    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:41:17.223654 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:17.223619    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"]
Jul 28 13:41:17.256437 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:17.256401    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:41:18.163866 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:18.163830    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:41:24.086106 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:24.086073    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:41:31.106559 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:31.106524    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:41:32.243788 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.243744    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v" podUID="339f306f-c087-49df-bd5f-460b0537403a" containerName="main" containerID="cri-o://2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03" gracePeriod=45
Jul 28 13:41:32.505483 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.505419    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:41:32.575025 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.574993    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-dshm\") pod \"339f306f-c087-49df-bd5f-460b0537403a\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") "
Jul 28 13:41:32.575206 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575114    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-model-cache\") pod \"339f306f-c087-49df-bd5f-460b0537403a\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") "
Jul 28 13:41:32.575206 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575143    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j96nn\" (UniqueName: \"kubernetes.io/projected/339f306f-c087-49df-bd5f-460b0537403a-kube-api-access-j96nn\") pod \"339f306f-c087-49df-bd5f-460b0537403a\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") "
Jul 28 13:41:32.575206 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575173    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339f306f-c087-49df-bd5f-460b0537403a-tls-certs\") pod \"339f306f-c087-49df-bd5f-460b0537403a\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") "
Jul 28 13:41:32.575327 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575220    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-home\") pod \"339f306f-c087-49df-bd5f-460b0537403a\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") "
Jul 28 13:41:32.575327 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575249    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-tmp-dir\") pod \"339f306f-c087-49df-bd5f-460b0537403a\" (UID: \"339f306f-c087-49df-bd5f-460b0537403a\") "
Jul 28 13:41:32.575458 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575424    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-model-cache" (OuterVolumeSpecName: "model-cache") pod "339f306f-c087-49df-bd5f-460b0537403a" (UID: "339f306f-c087-49df-bd5f-460b0537403a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:41:32.575553 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575519    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-home" (OuterVolumeSpecName: "home") pod "339f306f-c087-49df-bd5f-460b0537403a" (UID: "339f306f-c087-49df-bd5f-460b0537403a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:41:32.575617 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575566    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "339f306f-c087-49df-bd5f-460b0537403a" (UID: "339f306f-c087-49df-bd5f-460b0537403a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:41:32.575721 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575701    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-tmp-dir\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:41:32.575773 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575729    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-model-cache\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:41:32.575773 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.575743    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-home\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:41:32.577342 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.577319    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-dshm" (OuterVolumeSpecName: "dshm") pod "339f306f-c087-49df-bd5f-460b0537403a" (UID: "339f306f-c087-49df-bd5f-460b0537403a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:41:32.577342 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.577325    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/339f306f-c087-49df-bd5f-460b0537403a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "339f306f-c087-49df-bd5f-460b0537403a" (UID: "339f306f-c087-49df-bd5f-460b0537403a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 13:41:32.577510 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.577327    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/339f306f-c087-49df-bd5f-460b0537403a-kube-api-access-j96nn" (OuterVolumeSpecName: "kube-api-access-j96nn") pod "339f306f-c087-49df-bd5f-460b0537403a" (UID: "339f306f-c087-49df-bd5f-460b0537403a"). InnerVolumeSpecName "kube-api-access-j96nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:41:32.676839 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.676798    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339f306f-c087-49df-bd5f-460b0537403a-dshm\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:41:32.676839 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.676833    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j96nn\" (UniqueName: \"kubernetes.io/projected/339f306f-c087-49df-bd5f-460b0537403a-kube-api-access-j96nn\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:41:32.676839 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:32.676844    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339f306f-c087-49df-bd5f-460b0537403a-tls-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:41:33.090470 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:33.090437    2567 generic.go:356] "Generic (PLEG): container finished" podID="339f306f-c087-49df-bd5f-460b0537403a" containerID="2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03" exitCode=0
Jul 28 13:41:33.090683 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:33.090481    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"
Jul 28 13:41:33.090683 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:33.090523    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v" event={"ID":"339f306f-c087-49df-bd5f-460b0537403a","Type":"ContainerDied","Data":"2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03"}
Jul 28 13:41:33.090683 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:33.090573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v" event={"ID":"339f306f-c087-49df-bd5f-460b0537403a","Type":"ContainerDied","Data":"3bfaf38c66f8289418ce2fca2641b6a4f3ebba3224bb326689d689d31fbc17a6"}
Jul 28 13:41:33.090683 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:33.090589    2567 scope.go:117] "RemoveContainer" containerID="2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03"
Jul 28 13:41:33.100946 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:33.100914    2567 scope.go:117] "RemoveContainer" containerID="2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03"
Jul 28 13:41:33.101213 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:41:33.101191    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03\": container with ID starting with 2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03 not found: ID does not exist" containerID="2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03"
Jul 28 13:41:33.101288 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:33.101226    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03"} err="failed to get container status \"2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03\": rpc error: code = NotFound desc = could not find container \"2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03\": container with ID starting with 2d2824f12a19bc915e27874447fa2b1eb4893a1673baf6f61e3d280649dfaa03 not found: ID does not exist"
Jul 28 13:41:33.112931 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:33.112902    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"]
Jul 28 13:41:33.116128 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:33.116107    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2c9e23/sub-test-model-2c9e23-kserve-7f9fdcdd8c-4ht5v"]
Jul 28 13:41:33.501612 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:33.501529    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="339f306f-c087-49df-bd5f-460b0537403a" path="/var/lib/kubelet/pods/339f306f-c087-49df-bd5f-460b0537403a/volumes"
Jul 28 13:41:48.825412 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:41:48.825377    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:10.747900 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:10.747868    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:11.643712 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:11.643677    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:18.254766 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.254729    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7002-140696164038672"]
Jul 28 13:43:18.255213 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.255158    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="339f306f-c087-49df-bd5f-460b0537403a" containerName="main"
Jul 28 13:43:18.255213 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.255170    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="339f306f-c087-49df-bd5f-460b0537403a" containerName="main"
Jul 28 13:43:18.255297 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.255241    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="339f306f-c087-49df-bd5f-460b0537403a" containerName="main"
Jul 28 13:43:18.257942 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.257906    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7002-140696164038672"
Jul 28 13:43:18.260642 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.260617    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7n25w\""
Jul 28 13:43:18.264095 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.264068    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7002-140696164038672"]
Jul 28 13:43:18.279900 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.279868    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h57p\" (UniqueName: \"kubernetes.io/projected/776edc9c-3d9c-49b9-8833-ee998f942c55-kube-api-access-9h57p\") pod \"test-curl-7002-140696164038672\" (UID: \"776edc9c-3d9c-49b9-8833-ee998f942c55\") " pod="opendatahub/test-curl-7002-140696164038672"
Jul 28 13:43:18.381031 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.380995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h57p\" (UniqueName: \"kubernetes.io/projected/776edc9c-3d9c-49b9-8833-ee998f942c55-kube-api-access-9h57p\") pod \"test-curl-7002-140696164038672\" (UID: \"776edc9c-3d9c-49b9-8833-ee998f942c55\") " pod="opendatahub/test-curl-7002-140696164038672"
Jul 28 13:43:18.390303 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.390272    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h57p\" (UniqueName: \"kubernetes.io/projected/776edc9c-3d9c-49b9-8833-ee998f942c55-kube-api-access-9h57p\") pod \"test-curl-7002-140696164038672\" (UID: \"776edc9c-3d9c-49b9-8833-ee998f942c55\") " pod="opendatahub/test-curl-7002-140696164038672"
Jul 28 13:43:18.569764 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.569721    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7002-140696164038672"
Jul 28 13:43:18.709740 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.709712    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7002-140696164038672"]
Jul 28 13:43:18.712296 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:43:18.712267    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod776edc9c_3d9c_49b9_8833_ee998f942c55.slice/crio-542e3822b5c3fcbc26b3522c06501b29cfc0ed264893c07e128ebbb292c43835 WatchSource:0}: Error finding container 542e3822b5c3fcbc26b3522c06501b29cfc0ed264893c07e128ebbb292c43835: Status 404 returned error can't find the container with id 542e3822b5c3fcbc26b3522c06501b29cfc0ed264893c07e128ebbb292c43835
Jul 28 13:43:18.713504 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:18.713486    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:43:19.697084 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:19.696982    2567 generic.go:356] "Generic (PLEG): container finished" podID="776edc9c-3d9c-49b9-8833-ee998f942c55" containerID="5290a2592eb5101b2da73f3a5579b7292911f89d9bff62672fb968c4c04c9a32" exitCode=0
Jul 28 13:43:19.697084 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:19.697067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7002-140696164038672" event={"ID":"776edc9c-3d9c-49b9-8833-ee998f942c55","Type":"ContainerDied","Data":"5290a2592eb5101b2da73f3a5579b7292911f89d9bff62672fb968c4c04c9a32"}
Jul 28 13:43:19.697487 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:19.697110    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7002-140696164038672" event={"ID":"776edc9c-3d9c-49b9-8833-ee998f942c55","Type":"ContainerStarted","Data":"542e3822b5c3fcbc26b3522c06501b29cfc0ed264893c07e128ebbb292c43835"}
Jul 28 13:43:20.852367 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:20.852334    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7002-140696164038672"
Jul 28 13:43:20.878483 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:20.878453    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7002-140696164038672_776edc9c-3d9c-49b9-8833-ee998f942c55/test-curl-7002-140696164038672/0.log"
Jul 28 13:43:20.898803 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:20.898766    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h57p\" (UniqueName: \"kubernetes.io/projected/776edc9c-3d9c-49b9-8833-ee998f942c55-kube-api-access-9h57p\") pod \"776edc9c-3d9c-49b9-8833-ee998f942c55\" (UID: \"776edc9c-3d9c-49b9-8833-ee998f942c55\") "
Jul 28 13:43:20.901360 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:20.901319    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/776edc9c-3d9c-49b9-8833-ee998f942c55-kube-api-access-9h57p" (OuterVolumeSpecName: "kube-api-access-9h57p") pod "776edc9c-3d9c-49b9-8833-ee998f942c55" (UID: "776edc9c-3d9c-49b9-8833-ee998f942c55"). InnerVolumeSpecName "kube-api-access-9h57p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:43:20.905768 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:20.905718    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7002-140696164038672"]
Jul 28 13:43:20.909877 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:20.909853    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7002-140696164038672"]
Jul 28 13:43:20.999565 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:20.999474    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h57p\" (UniqueName: \"kubernetes.io/projected/776edc9c-3d9c-49b9-8833-ee998f942c55-kube-api-access-9h57p\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:43:21.500686 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:21.500652    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="776edc9c-3d9c-49b9-8833-ee998f942c55" path="/var/lib/kubelet/pods/776edc9c-3d9c-49b9-8833-ee998f942c55/volumes"
Jul 28 13:43:21.709900 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:21.709871    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7002-140696164038672"
Jul 28 13:43:21.710099 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:21.709882    2567 scope.go:117] "RemoveContainer" containerID="5290a2592eb5101b2da73f3a5579b7292911f89d9bff62672fb968c4c04c9a32"
Jul 28 13:43:29.743639 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:29.743608    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:31.273062 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:31.273031    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:33.057549 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:33.057514    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:33.245249 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:33.245207    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:33.343398 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:33.343309    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:33.439428 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:33.439389    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:33.801124 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:33.801095    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:33.902469 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:33.902438    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:33.999475 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:33.999440    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"]
Jul 28 13:43:33.999840 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:33.999827    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="776edc9c-3d9c-49b9-8833-ee998f942c55" containerName="test-curl-7002-140696164038672"
Jul 28 13:43:33.999890 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:33.999841    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="776edc9c-3d9c-49b9-8833-ee998f942c55" containerName="test-curl-7002-140696164038672"
Jul 28 13:43:33.999953 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:33.999911    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="776edc9c-3d9c-49b9-8833-ee998f942c55" containerName="test-curl-7002-140696164038672"
Jul 28 13:43:34.003077 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.003060    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:43:34.005707 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.005684    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-15d223\""
Jul 28 13:43:34.005859 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.005684    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-15d223-dockercfg-9gv86\""
Jul 28 13:43:34.014884 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.014858    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"]
Jul 28 13:43:34.067282 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.067202    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"]
Jul 28 13:43:34.070657 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.070636    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:43:34.081464 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.081436    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"]
Jul 28 13:43:34.110099 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.110066    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db6nw\" (UniqueName: \"kubernetes.io/projected/2b84a497-e556-4560-9129-4e88da97f739-kube-api-access-db6nw\") pod \"payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg\" (UID: \"2b84a497-e556-4560-9129-4e88da97f739\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:43:34.110299 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.110144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b84a497-e556-4560-9129-4e88da97f739-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg\" (UID: \"2b84a497-e556-4560-9129-4e88da97f739\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:43:34.110299 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.110182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t44jx\" (UniqueName: \"kubernetes.io/projected/a95b6ed3-eceb-44bf-90e5-f5c647729595-kube-api-access-t44jx\") pod \"payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb\" (UID: \"a95b6ed3-eceb-44bf-90e5-f5c647729595\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:43:34.110299 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.110214    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95b6ed3-eceb-44bf-90e5-f5c647729595-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb\" (UID: \"a95b6ed3-eceb-44bf-90e5-f5c647729595\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:43:34.210677 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.210638    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db6nw\" (UniqueName: \"kubernetes.io/projected/2b84a497-e556-4560-9129-4e88da97f739-kube-api-access-db6nw\") pod \"payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg\" (UID: \"2b84a497-e556-4560-9129-4e88da97f739\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:43:34.210855 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.210737    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b84a497-e556-4560-9129-4e88da97f739-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg\" (UID: \"2b84a497-e556-4560-9129-4e88da97f739\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:43:34.210855 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.210771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t44jx\" (UniqueName: \"kubernetes.io/projected/a95b6ed3-eceb-44bf-90e5-f5c647729595-kube-api-access-t44jx\") pod \"payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb\" (UID: \"a95b6ed3-eceb-44bf-90e5-f5c647729595\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:43:34.210855 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.210815    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95b6ed3-eceb-44bf-90e5-f5c647729595-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb\" (UID: \"a95b6ed3-eceb-44bf-90e5-f5c647729595\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:43:34.211519 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.211499    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b84a497-e556-4560-9129-4e88da97f739-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg\" (UID: \"2b84a497-e556-4560-9129-4e88da97f739\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:43:34.211574 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.211526    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95b6ed3-eceb-44bf-90e5-f5c647729595-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb\" (UID: \"a95b6ed3-eceb-44bf-90e5-f5c647729595\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:43:34.223200 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.223171    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t44jx\" (UniqueName: \"kubernetes.io/projected/a95b6ed3-eceb-44bf-90e5-f5c647729595-kube-api-access-t44jx\") pod \"payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb\" (UID: \"a95b6ed3-eceb-44bf-90e5-f5c647729595\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:43:34.223352 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.223280    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db6nw\" (UniqueName: \"kubernetes.io/projected/2b84a497-e556-4560-9129-4e88da97f739-kube-api-access-db6nw\") pod \"payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg\" (UID: \"2b84a497-e556-4560-9129-4e88da97f739\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:43:34.313802 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.313769    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:43:34.381651 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.381394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:43:34.479699 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.479672    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"]
Jul 28 13:43:34.481052 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:43:34.481029    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b84a497_e556_4560_9129_4e88da97f739.slice/crio-bca084b6ff2d9df72365ad853f4b6f237f379882676d9ef10da38608147be6ec WatchSource:0}: Error finding container bca084b6ff2d9df72365ad853f4b6f237f379882676d9ef10da38608147be6ec: Status 404 returned error can't find the container with id bca084b6ff2d9df72365ad853f4b6f237f379882676d9ef10da38608147be6ec
Jul 28 13:43:34.568412 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.568386    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"]
Jul 28 13:43:34.569981 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:43:34.569909    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95b6ed3_eceb_44bf_90e5_f5c647729595.slice/crio-38234da3bc943f6a2c3fc74da5082002579b410535193ede74a26b1985748da0 WatchSource:0}: Error finding container 38234da3bc943f6a2c3fc74da5082002579b410535193ede74a26b1985748da0: Status 404 returned error can't find the container with id 38234da3bc943f6a2c3fc74da5082002579b410535193ede74a26b1985748da0
Jul 28 13:43:34.788837 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.788800    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg" event={"ID":"2b84a497-e556-4560-9129-4e88da97f739","Type":"ContainerStarted","Data":"3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4"}
Jul 28 13:43:34.789066 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.788871    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:43:34.789066 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.788895    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg" event={"ID":"2b84a497-e556-4560-9129-4e88da97f739","Type":"ContainerStarted","Data":"bca084b6ff2d9df72365ad853f4b6f237f379882676d9ef10da38608147be6ec"}
Jul 28 13:43:34.790323 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.790295    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb" event={"ID":"a95b6ed3-eceb-44bf-90e5-f5c647729595","Type":"ContainerStarted","Data":"303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3"}
Jul 28 13:43:34.790428 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.790337    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb" event={"ID":"a95b6ed3-eceb-44bf-90e5-f5c647729595","Type":"ContainerStarted","Data":"38234da3bc943f6a2c3fc74da5082002579b410535193ede74a26b1985748da0"}
Jul 28 13:43:34.790428 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.790383    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:43:34.807859 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.807810    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg" podStartSLOduration=1.807793526 podStartE2EDuration="1.807793526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:34.807001186 +0000 UTC m=+3141.736285104" watchObservedRunningTime="2026-07-28 13:43:34.807793526 +0000 UTC m=+3141.737077443"
Jul 28 13:43:34.827026 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:34.826913    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb" podStartSLOduration=0.826895254 podStartE2EDuration="826.895254ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:43:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:43:34.825765213 +0000 UTC m=+3141.755049130" watchObservedRunningTime="2026-07-28 13:43:34.826895254 +0000 UTC m=+3141.756179171"
Jul 28 13:43:45.797972 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:45.797935    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:43:45.798598 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:45.798117    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:43:58.099597 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:58.099559    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:58.828341 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:58.828296    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:59.235635 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:59.235547    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:43:59.988857 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:43:59.988824    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:02.243151 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:02.243114    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:02.360381 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:02.360347    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:02.470589 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:02.470555    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:02.637044 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:02.637005    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:03.362245 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.362199    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:03.515595 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.515553    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:03.589718 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.589677    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"]
Jul 28 13:44:03.593410 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.593386    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:44:03.596244 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.596207    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-220710-dockercfg-vlwjm\""
Jul 28 13:44:03.596434 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.596415    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-220710\""
Jul 28 13:44:03.601789 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.601357    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/818d7499-052a-49d0-84f3-4735cf0207b9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2\" (UID: \"818d7499-052a-49d0-84f3-4735cf0207b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:44:03.601789 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.601438    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwjx9\" (UniqueName: \"kubernetes.io/projected/818d7499-052a-49d0-84f3-4735cf0207b9-kube-api-access-wwjx9\") pod \"payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2\" (UID: \"818d7499-052a-49d0-84f3-4735cf0207b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:44:03.607129 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.607095    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"]
Jul 28 13:44:03.702780 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.702677    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/818d7499-052a-49d0-84f3-4735cf0207b9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2\" (UID: \"818d7499-052a-49d0-84f3-4735cf0207b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:44:03.702780 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.702733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwjx9\" (UniqueName: \"kubernetes.io/projected/818d7499-052a-49d0-84f3-4735cf0207b9-kube-api-access-wwjx9\") pod \"payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2\" (UID: \"818d7499-052a-49d0-84f3-4735cf0207b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:44:03.703402 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.703380    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/818d7499-052a-49d0-84f3-4735cf0207b9-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2\" (UID: \"818d7499-052a-49d0-84f3-4735cf0207b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:44:03.715796 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.715764    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwjx9\" (UniqueName: \"kubernetes.io/projected/818d7499-052a-49d0-84f3-4735cf0207b9-kube-api-access-wwjx9\") pod \"payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2\" (UID: \"818d7499-052a-49d0-84f3-4735cf0207b9\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:44:03.906539 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:03.906495    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:44:04.061330 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:04.061238    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"]
Jul 28 13:44:04.062391 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:44:04.062352    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818d7499_052a_49d0_84f3_4735cf0207b9.slice/crio-8246f41f917970b96e81c5fa5531d09fdd49e91ef7c474a436b26c71c7446fcf WatchSource:0}: Error finding container 8246f41f917970b96e81c5fa5531d09fdd49e91ef7c474a436b26c71c7446fcf: Status 404 returned error can't find the container with id 8246f41f917970b96e81c5fa5531d09fdd49e91ef7c474a436b26c71c7446fcf
Jul 28 13:44:04.980750 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:04.980708    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2" event={"ID":"818d7499-052a-49d0-84f3-4735cf0207b9","Type":"ContainerStarted","Data":"1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6"}
Jul 28 13:44:04.981196 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:04.980767    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2" event={"ID":"818d7499-052a-49d0-84f3-4735cf0207b9","Type":"ContainerStarted","Data":"8246f41f917970b96e81c5fa5531d09fdd49e91ef7c474a436b26c71c7446fcf"}
Jul 28 13:44:04.981196 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:04.980789    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:44:05.006754 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:05.006699    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2" podStartSLOduration=2.006679431 podStartE2EDuration="2.006679431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:44:05.005480631 +0000 UTC m=+3171.934764548" watchObservedRunningTime="2026-07-28 13:44:05.006679431 +0000 UTC m=+3171.935963348"
Jul 28 13:44:15.989276 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:15.989246    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:44:19.707760 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:19.707727    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:19.940056 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:19.940004    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:27.238557 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:27.238509    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:34.425105 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:34.425069    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2_818d7499-052a-49d0-84f3-4735cf0207b9/payload-processing/0.log"
Jul 28 13:44:37.978912 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:37.978869    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:44:38.043406 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:44:38.043371    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:45:00.169213 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:00.169179    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v"]
Jul 28 13:45:00.172794 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:00.172761    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v"
Jul 28 13:45:00.175744 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:00.175715    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6qfh\""
Jul 28 13:45:00.184625 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:00.184589    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v"]
Jul 28 13:45:00.185217 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:00.185189    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v"
Jul 28 13:45:00.341868 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:00.341843    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v"]
Jul 28 13:45:00.343572 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:45:00.343542    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8988ac05_d28d_4182_b6f4_cabf3578d92b.slice/crio-31eabaa18c366e8eb40e92f8055bb0efbfa34da08aaeaec6b76c4cfdb1d0c946 WatchSource:0}: Error finding container 31eabaa18c366e8eb40e92f8055bb0efbfa34da08aaeaec6b76c4cfdb1d0c946: Status 404 returned error can't find the container with id 31eabaa18c366e8eb40e92f8055bb0efbfa34da08aaeaec6b76c4cfdb1d0c946
Jul 28 13:45:01.319482 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:01.319445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v" event={"ID":"8988ac05-d28d-4182-b6f4-cabf3578d92b","Type":"ContainerStarted","Data":"e5a415ffba375daa713ae82ba900e1a3d1cae66965a5b83d82f1a5516f165024"}
Jul 28 13:45:01.319949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:01.319499    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v" event={"ID":"8988ac05-d28d-4182-b6f4-cabf3578d92b","Type":"ContainerStarted","Data":"31eabaa18c366e8eb40e92f8055bb0efbfa34da08aaeaec6b76c4cfdb1d0c946"}
Jul 28 13:45:01.331174 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:01.331137    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:45:01.345688 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:01.345637    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v" podStartSLOduration=1.34562142 podStartE2EDuration="1.34562142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:45:01.343513593 +0000 UTC m=+3228.272797510" watchObservedRunningTime="2026-07-28 13:45:01.34562142 +0000 UTC m=+3228.274905409"
Jul 28 13:45:02.327645 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:02.327614    2567 generic.go:356] "Generic (PLEG): container finished" podID="8988ac05-d28d-4182-b6f4-cabf3578d92b" containerID="e5a415ffba375daa713ae82ba900e1a3d1cae66965a5b83d82f1a5516f165024" exitCode=0
Jul 28 13:45:02.328068 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:02.327696    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v" event={"ID":"8988ac05-d28d-4182-b6f4-cabf3578d92b","Type":"ContainerDied","Data":"e5a415ffba375daa713ae82ba900e1a3d1cae66965a5b83d82f1a5516f165024"}
Jul 28 13:45:03.482473 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:03.482448    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v"
Jul 28 13:45:04.341791 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:04.341754    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v"
Jul 28 13:45:04.341966 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:04.341786    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v" event={"ID":"8988ac05-d28d-4182-b6f4-cabf3578d92b","Type":"ContainerDied","Data":"31eabaa18c366e8eb40e92f8055bb0efbfa34da08aaeaec6b76c4cfdb1d0c946"}
Jul 28 13:45:04.341966 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:04.341859    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31eabaa18c366e8eb40e92f8055bb0efbfa34da08aaeaec6b76c4cfdb1d0c946"
Jul 28 13:45:47.112341 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:47.112306    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb_a95b6ed3-eceb-44bf-90e5-f5c647729595/payload-processing/0.log"
Jul 28 13:45:47.378533 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:47.378452    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2_818d7499-052a-49d0-84f3-4735cf0207b9/payload-processing/0.log"
Jul 28 13:45:47.696355 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:47.696263    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:45:48.125324 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.125282    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"]
Jul 28 13:45:48.125726 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.125688    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8988ac05-d28d-4182-b6f4-cabf3578d92b" containerName="cleanup"
Jul 28 13:45:48.125726 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.125699    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8988ac05-d28d-4182-b6f4-cabf3578d92b" containerName="cleanup"
Jul 28 13:45:48.125813 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.125779    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8988ac05-d28d-4182-b6f4-cabf3578d92b" containerName="cleanup"
Jul 28 13:45:48.129013 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.128991    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.132048 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.132020    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-ed36e3-openshift-default-dockercfg-g26q2\""
Jul 28 13:45:48.147632 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.147601    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"]
Jul 28 13:45:48.153216 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.153162    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:45:48.215055 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.215016    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-socket\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.215272 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.215062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-credential-socket\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.215272 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.215110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-certs\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.215272 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.215135    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a231c5-48b5-4fee-a49b-67024e274210-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.215272 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.215159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l8jc\" (UniqueName: \"kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-kube-api-access-2l8jc\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.215272 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.215205    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-istio-token\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.215561 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.215348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-data\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.215561 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.215411    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-envoy\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.215561 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.215455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a231c5-48b5-4fee-a49b-67024e274210-istio-podinfo\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.261246 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.261213    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:45:48.316623 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.316575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-certs\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.316623 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.316625    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a231c5-48b5-4fee-a49b-67024e274210-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317132 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.316657    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l8jc\" (UniqueName: \"kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-kube-api-access-2l8jc\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317132 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.316703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-istio-token\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317132 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.316739    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-data\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317132 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.316782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-envoy\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317132 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.316814    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a231c5-48b5-4fee-a49b-67024e274210-istio-podinfo\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317132 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.316954    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-socket\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317132 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.316988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-credential-socket\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317132 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.317059    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-certs\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317591 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.317410    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a231c5-48b5-4fee-a49b-67024e274210-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317591 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.317512    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-data\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317591 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.317540    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-socket\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.317758 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.317733    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-credential-socket\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.319595 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.319566    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-envoy\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.320367 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.320344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a231c5-48b5-4fee-a49b-67024e274210-istio-podinfo\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.326806 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.326773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-istio-token\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.327004 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.326981    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l8jc\" (UniqueName: \"kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-kube-api-access-2l8jc\") pod \"e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") " pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.440640 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.440542    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:48.597249 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:45:48.597211    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a231c5_48b5_4fee_a49b_67024e274210.slice/crio-7cb81c8a199104fee8bae5cf301143c32baa77ced823d2134043f5f150cb54bf WatchSource:0}: Error finding container 7cb81c8a199104fee8bae5cf301143c32baa77ced823d2134043f5f150cb54bf: Status 404 returned error can't find the container with id 7cb81c8a199104fee8bae5cf301143c32baa77ced823d2134043f5f150cb54bf
Jul 28 13:45:48.598544 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.598520    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"]
Jul 28 13:45:48.605867 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.599999    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:45:48.605867 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.600192    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:45:48.605867 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:48.600292    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:45:49.607249 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:49.607208    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" event={"ID":"74a231c5-48b5-4fee-a49b-67024e274210","Type":"ContainerStarted","Data":"988bfadf14edc52202e61e254f55be5a31f013bd33ad36b155ac3a401a5aa62e"}
Jul 28 13:45:49.607718 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:49.607265    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" event={"ID":"74a231c5-48b5-4fee-a49b-67024e274210","Type":"ContainerStarted","Data":"7cb81c8a199104fee8bae5cf301143c32baa77ced823d2134043f5f150cb54bf"}
Jul 28 13:45:49.636416 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:49.636361    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" podStartSLOduration=1.636344832 podStartE2EDuration="1.636344832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:45:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:45:49.63334347 +0000 UTC m=+3276.562627408" watchObservedRunningTime="2026-07-28 13:45:49.636344832 +0000 UTC m=+3276.565628750"
Jul 28 13:45:50.441452 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:50.441415    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:50.446874 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:50.446847    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:50.612797 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:50.612764    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:50.613783 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:50.613763    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:45:51.750403 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:51.750365    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:45:51.851407 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:51.851371    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:45:52.008511 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:52.008417    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:45:52.580873 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:52.580830    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:45:52.686903 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:52.686864    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:45:52.828026 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:52.827993    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"]
Jul 28 13:45:52.832161 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:52.832089    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:45:52.835110 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:52.835075    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-ed36e3-dockercfg-4qr4h\""
Jul 28 13:45:52.835278 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:52.835132    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-ed36e3\""
Jul 28 13:45:52.847327 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:52.847276    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"]
Jul 28 13:45:52.963262 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:52.963220    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clrck\" (UniqueName: \"kubernetes.io/projected/118bf070-cc95-4dc0-8180-3880fa243205-kube-api-access-clrck\") pod \"payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7\" (UID: \"118bf070-cc95-4dc0-8180-3880fa243205\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:45:52.963449 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:52.963395    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/118bf070-cc95-4dc0-8180-3880fa243205-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7\" (UID: \"118bf070-cc95-4dc0-8180-3880fa243205\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:45:53.064342 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:53.064297    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clrck\" (UniqueName: \"kubernetes.io/projected/118bf070-cc95-4dc0-8180-3880fa243205-kube-api-access-clrck\") pod \"payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7\" (UID: \"118bf070-cc95-4dc0-8180-3880fa243205\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:45:53.064532 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:53.064418    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/118bf070-cc95-4dc0-8180-3880fa243205-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7\" (UID: \"118bf070-cc95-4dc0-8180-3880fa243205\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:45:53.065199 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:53.065171    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/118bf070-cc95-4dc0-8180-3880fa243205-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7\" (UID: \"118bf070-cc95-4dc0-8180-3880fa243205\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:45:53.082787 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:53.082704    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clrck\" (UniqueName: \"kubernetes.io/projected/118bf070-cc95-4dc0-8180-3880fa243205-kube-api-access-clrck\") pod \"payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7\" (UID: \"118bf070-cc95-4dc0-8180-3880fa243205\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:45:53.144515 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:53.144473    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:45:53.293021 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:53.292990    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"]
Jul 28 13:45:53.294125 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:45:53.294092    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118bf070_cc95_4dc0_8180_3880fa243205.slice/crio-fe3f57a8e3ed12c1e1358a433f69e5387db18e7373a788db41947eca725d2bff WatchSource:0}: Error finding container fe3f57a8e3ed12c1e1358a433f69e5387db18e7373a788db41947eca725d2bff: Status 404 returned error can't find the container with id fe3f57a8e3ed12c1e1358a433f69e5387db18e7373a788db41947eca725d2bff
Jul 28 13:45:53.634570 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:53.634480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7" event={"ID":"118bf070-cc95-4dc0-8180-3880fa243205","Type":"ContainerStarted","Data":"66b9962ec826885d6f99f01a6179b00d892c18aa103a63405ab1843c852ebaf5"}
Jul 28 13:45:53.634570 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:53.634554    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:45:53.634788 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:53.634581    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7" event={"ID":"118bf070-cc95-4dc0-8180-3880fa243205","Type":"ContainerStarted","Data":"fe3f57a8e3ed12c1e1358a433f69e5387db18e7373a788db41947eca725d2bff"}
Jul 28 13:45:53.704423 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:45:53.704366    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7" podStartSLOduration=1.704348921 podStartE2EDuration="1.704348921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:45:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:45:53.701751951 +0000 UTC m=+3280.631035868" watchObservedRunningTime="2026-07-28 13:45:53.704348921 +0000 UTC m=+3280.633632838"
Jul 28 13:46:04.643460 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:04.643426    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:46:09.736079 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:09.735971    2567 generic.go:356] "Generic (PLEG): container finished" podID="74a231c5-48b5-4fee-a49b-67024e274210" containerID="988bfadf14edc52202e61e254f55be5a31f013bd33ad36b155ac3a401a5aa62e" exitCode=0
Jul 28 13:46:09.736079 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:09.736050    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" event={"ID":"74a231c5-48b5-4fee-a49b-67024e274210","Type":"ContainerDied","Data":"988bfadf14edc52202e61e254f55be5a31f013bd33ad36b155ac3a401a5aa62e"}
Jul 28 13:46:09.736566 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:09.736477    2567 scope.go:117] "RemoveContainer" containerID="988bfadf14edc52202e61e254f55be5a31f013bd33ad36b155ac3a401a5aa62e"
Jul 28 13:46:09.737728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:09.737699    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:46:09.737805 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:09.737774    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:46:09.737843 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:09.737810    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 13:46:10.743855 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:10.743823    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" event={"ID":"74a231c5-48b5-4fee-a49b-67024e274210","Type":"ContainerStarted","Data":"91509d65bdd34823a1f0c2e97039998c32ca2202791bd0eb83429d925e7c2fe6"}
Jul 28 13:46:11.441425 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:11.441377    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:46:11.441692 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:11.441519    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Jul 28 13:46:11.441692 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:11.441599    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Jul 28 13:46:12.441553 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:12.441507    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Jul 28 13:46:12.442215 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:12.442176    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Jul 28 13:46:13.441778 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:13.441735    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Jul 28 13:46:13.442323 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:13.441818    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Jul 28 13:46:14.455230 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:14.455192    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused" start-of-body=
Jul 28 13:46:14.455759 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:14.455258    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.86:15021/healthz/ready\": dial tcp 10.133.0.86:15021: connect: connection refused"
Jul 28 13:46:15.445785 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:15.445756    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:46:15.446151 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:15.446125    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:46:15.447089 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:15.447071    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:46:18.127454 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:18.127417    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:22.549305 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.549263    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:22.597144 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.597107    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"]
Jul 28 13:46:22.597404 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.597372    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7" podUID="118bf070-cc95-4dc0-8180-3880fa243205" containerName="payload-pre-processing" containerID="cri-o://66b9962ec826885d6f99f01a6179b00d892c18aa103a63405ab1843c852ebaf5" gracePeriod=30
Jul 28 13:46:22.649726 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.649670    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:22.751072 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.751028    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:22.835544 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.835454    2567 generic.go:356] "Generic (PLEG): container finished" podID="118bf070-cc95-4dc0-8180-3880fa243205" containerID="66b9962ec826885d6f99f01a6179b00d892c18aa103a63405ab1843c852ebaf5" exitCode=0
Jul 28 13:46:22.835544 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.835518    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7" event={"ID":"118bf070-cc95-4dc0-8180-3880fa243205","Type":"ContainerDied","Data":"66b9962ec826885d6f99f01a6179b00d892c18aa103a63405ab1843c852ebaf5"}
Jul 28 13:46:22.864982 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.864951    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:46:22.878903 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.878870    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:22.965381 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.965351    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clrck\" (UniqueName: \"kubernetes.io/projected/118bf070-cc95-4dc0-8180-3880fa243205-kube-api-access-clrck\") pod \"118bf070-cc95-4dc0-8180-3880fa243205\" (UID: \"118bf070-cc95-4dc0-8180-3880fa243205\") "
Jul 28 13:46:22.965558 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.965506    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/118bf070-cc95-4dc0-8180-3880fa243205-plugins-config-volume\") pod \"118bf070-cc95-4dc0-8180-3880fa243205\" (UID: \"118bf070-cc95-4dc0-8180-3880fa243205\") "
Jul 28 13:46:22.965895 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.965871    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/118bf070-cc95-4dc0-8180-3880fa243205-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "118bf070-cc95-4dc0-8180-3880fa243205" (UID: "118bf070-cc95-4dc0-8180-3880fa243205"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:46:22.967550 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:22.967520    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/118bf070-cc95-4dc0-8180-3880fa243205-kube-api-access-clrck" (OuterVolumeSpecName: "kube-api-access-clrck") pod "118bf070-cc95-4dc0-8180-3880fa243205" (UID: "118bf070-cc95-4dc0-8180-3880fa243205"). InnerVolumeSpecName "kube-api-access-clrck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:46:23.067171 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:23.067125    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/118bf070-cc95-4dc0-8180-3880fa243205-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:23.067171 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:23.067160    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clrck\" (UniqueName: \"kubernetes.io/projected/118bf070-cc95-4dc0-8180-3880fa243205-kube-api-access-clrck\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:23.274823 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:23.274789    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:23.842769 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:23.842738    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"
Jul 28 13:46:23.843307 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:23.842781    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7" event={"ID":"118bf070-cc95-4dc0-8180-3880fa243205","Type":"ContainerDied","Data":"fe3f57a8e3ed12c1e1358a433f69e5387db18e7373a788db41947eca725d2bff"}
Jul 28 13:46:23.843307 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:23.842847    2567 scope.go:117] "RemoveContainer" containerID="66b9962ec826885d6f99f01a6179b00d892c18aa103a63405ab1843c852ebaf5"
Jul 28 13:46:23.864990 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:23.864948    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"]
Jul 28 13:46:23.871353 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:23.871322    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-ed36e3-69568f699b-9xlb7"]
Jul 28 13:46:25.501095 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:25.501065    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="118bf070-cc95-4dc0-8180-3880fa243205" path="/var/lib/kubelet/pods/118bf070-cc95-4dc0-8180-3880fa243205/volumes"
Jul 28 13:46:30.511299 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:30.511257    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:30.622197 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:30.622158    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:30.797476 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:30.797441    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"]
Jul 28 13:46:30.797729 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:30.797704    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy" containerID="cri-o://91509d65bdd34823a1f0c2e97039998c32ca2202791bd0eb83429d925e7c2fe6" gracePeriod=30
Jul 28 13:46:30.835098 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:30.835063    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:31.079760 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:31.079665    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:35.919275 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:35.919241    2567 generic.go:356] "Generic (PLEG): container finished" podID="74a231c5-48b5-4fee-a49b-67024e274210" containerID="91509d65bdd34823a1f0c2e97039998c32ca2202791bd0eb83429d925e7c2fe6" exitCode=0
Jul 28 13:46:35.919633 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:35.919319    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" event={"ID":"74a231c5-48b5-4fee-a49b-67024e274210","Type":"ContainerDied","Data":"91509d65bdd34823a1f0c2e97039998c32ca2202791bd0eb83429d925e7c2fe6"}
Jul 28 13:46:35.919633 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:35.919405    2567 scope.go:117] "RemoveContainer" containerID="988bfadf14edc52202e61e254f55be5a31f013bd33ad36b155ac3a401a5aa62e"
Jul 28 13:46:36.079464 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.079440    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:46:36.203933 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.203891    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l8jc\" (UniqueName: \"kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-kube-api-access-2l8jc\") pod \"74a231c5-48b5-4fee-a49b-67024e274210\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") "
Jul 28 13:46:36.204129 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.203982    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-socket\") pod \"74a231c5-48b5-4fee-a49b-67024e274210\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") "
Jul 28 13:46:36.204129 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204092    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a231c5-48b5-4fee-a49b-67024e274210-istiod-ca-cert\") pod \"74a231c5-48b5-4fee-a49b-67024e274210\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") "
Jul 28 13:46:36.204261 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204151    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-credential-socket\") pod \"74a231c5-48b5-4fee-a49b-67024e274210\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") "
Jul 28 13:46:36.204261 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204196    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-istio-token\") pod \"74a231c5-48b5-4fee-a49b-67024e274210\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") "
Jul 28 13:46:36.204261 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204229    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-data\") pod \"74a231c5-48b5-4fee-a49b-67024e274210\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") "
Jul 28 13:46:36.204261 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204248    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74a231c5-48b5-4fee-a49b-67024e274210" (UID: "74a231c5-48b5-4fee-a49b-67024e274210"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:46:36.204470 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204257    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-envoy\") pod \"74a231c5-48b5-4fee-a49b-67024e274210\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") "
Jul 28 13:46:36.204470 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204367    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-certs\") pod \"74a231c5-48b5-4fee-a49b-67024e274210\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") "
Jul 28 13:46:36.204470 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204402    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a231c5-48b5-4fee-a49b-67024e274210-istio-podinfo\") pod \"74a231c5-48b5-4fee-a49b-67024e274210\" (UID: \"74a231c5-48b5-4fee-a49b-67024e274210\") "
Jul 28 13:46:36.204470 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204440    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74a231c5-48b5-4fee-a49b-67024e274210-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74a231c5-48b5-4fee-a49b-67024e274210" (UID: "74a231c5-48b5-4fee-a49b-67024e274210"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:46:36.204689 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204447    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74a231c5-48b5-4fee-a49b-67024e274210" (UID: "74a231c5-48b5-4fee-a49b-67024e274210"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:46:36.204689 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204610    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74a231c5-48b5-4fee-a49b-67024e274210" (UID: "74a231c5-48b5-4fee-a49b-67024e274210"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:46:36.204796 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204770    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:36.204796 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204788    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-workload-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:36.204903 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204801    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74a231c5-48b5-4fee-a49b-67024e274210-istiod-ca-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:36.204903 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.204815    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-credential-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:36.205285 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.205252    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-data" (OuterVolumeSpecName: "istio-data") pod "74a231c5-48b5-4fee-a49b-67024e274210" (UID: "74a231c5-48b5-4fee-a49b-67024e274210"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:46:36.206532 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.206502    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74a231c5-48b5-4fee-a49b-67024e274210" (UID: "74a231c5-48b5-4fee-a49b-67024e274210"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:46:36.206532 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.206526    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74a231c5-48b5-4fee-a49b-67024e274210-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74a231c5-48b5-4fee-a49b-67024e274210" (UID: "74a231c5-48b5-4fee-a49b-67024e274210"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:46:36.206687 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.206554    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-istio-token" (OuterVolumeSpecName: "istio-token") pod "74a231c5-48b5-4fee-a49b-67024e274210" (UID: "74a231c5-48b5-4fee-a49b-67024e274210"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:46:36.206687 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.206584    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-kube-api-access-2l8jc" (OuterVolumeSpecName: "kube-api-access-2l8jc") pod "74a231c5-48b5-4fee-a49b-67024e274210" (UID: "74a231c5-48b5-4fee-a49b-67024e274210"). InnerVolumeSpecName "kube-api-access-2l8jc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:46:36.305480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.305441    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74a231c5-48b5-4fee-a49b-67024e274210-istio-podinfo\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:36.305480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.305472    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2l8jc\" (UniqueName: \"kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-kube-api-access-2l8jc\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:36.305480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.305482    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74a231c5-48b5-4fee-a49b-67024e274210-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:36.305480 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.305490    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-data\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:36.305758 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.305498    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74a231c5-48b5-4fee-a49b-67024e274210-istio-envoy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:36.926856 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.926828    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"
Jul 28 13:46:36.927343 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.926885    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j" event={"ID":"74a231c5-48b5-4fee-a49b-67024e274210","Type":"ContainerDied","Data":"7cb81c8a199104fee8bae5cf301143c32baa77ced823d2134043f5f150cb54bf"}
Jul 28 13:46:36.927343 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.926975    2567 scope.go:117] "RemoveContainer" containerID="91509d65bdd34823a1f0c2e97039998c32ca2202791bd0eb83429d925e7c2fe6"
Jul 28 13:46:36.953499 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.953467    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"]
Jul 28 13:46:36.958492 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:36.958459    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ed36e3-openshift-default-674dd7859b-mlr5j"]
Jul 28 13:46:37.501873 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:37.501842    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74a231c5-48b5-4fee-a49b-67024e274210" path="/var/lib/kubelet/pods/74a231c5-48b5-4fee-a49b-67024e274210/volumes"
Jul 28 13:46:40.070009 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.069973    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"]
Jul 28 13:46:40.070436 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.070398    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy"
Jul 28 13:46:40.070436 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.070410    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy"
Jul 28 13:46:40.070436 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.070431    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="118bf070-cc95-4dc0-8180-3880fa243205" containerName="payload-pre-processing"
Jul 28 13:46:40.070436 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.070437    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="118bf070-cc95-4dc0-8180-3880fa243205" containerName="payload-pre-processing"
Jul 28 13:46:40.070578 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.070499    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy"
Jul 28 13:46:40.070578 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.070508    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy"
Jul 28 13:46:40.070578 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.070517    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="118bf070-cc95-4dc0-8180-3880fa243205" containerName="payload-pre-processing"
Jul 28 13:46:40.075149 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.075124    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"
Jul 28 13:46:40.078145 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.078116    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 13:46:40.078279 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.078116    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6qfh\""
Jul 28 13:46:40.084380 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.084353    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"]
Jul 28 13:46:40.244088 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.244051    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3571ccb3-d78e-4f61-9989-a3e5fa69ec4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h\" (UID: \"3571ccb3-d78e-4f61-9989-a3e5fa69ec4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"
Jul 28 13:46:40.344827 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.344727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3571ccb3-d78e-4f61-9989-a3e5fa69ec4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h\" (UID: \"3571ccb3-d78e-4f61-9989-a3e5fa69ec4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"
Jul 28 13:46:40.345400 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.345378    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3571ccb3-d78e-4f61-9989-a3e5fa69ec4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h\" (UID: \"3571ccb3-d78e-4f61-9989-a3e5fa69ec4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"
Jul 28 13:46:40.387616 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.387577    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"
Jul 28 13:46:40.535807 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.535772    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"]
Jul 28 13:46:40.536639 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:46:40.536611    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3571ccb3_d78e_4f61_9989_a3e5fa69ec4e.slice/crio-b1e378b1a931e799e215554c15d751e58cf951630d3eec9805d311f757cd0a14 WatchSource:0}: Error finding container b1e378b1a931e799e215554c15d751e58cf951630d3eec9805d311f757cd0a14: Status 404 returned error can't find the container with id b1e378b1a931e799e215554c15d751e58cf951630d3eec9805d311f757cd0a14
Jul 28 13:46:40.954910 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.954880    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h" event={"ID":"3571ccb3-d78e-4f61-9989-a3e5fa69ec4e","Type":"ContainerStarted","Data":"bbe47dabc623d94786bd9e209be8c73dc23e2a626911aea3f6bd1f176ee39bdb"}
Jul 28 13:46:40.955089 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.954953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h" event={"ID":"3571ccb3-d78e-4f61-9989-a3e5fa69ec4e","Type":"ContainerStarted","Data":"b1e378b1a931e799e215554c15d751e58cf951630d3eec9805d311f757cd0a14"}
Jul 28 13:46:40.977657 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:40.977604    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h" podStartSLOduration=0.977588298 podStartE2EDuration="977.588298ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:46:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:46:40.974982709 +0000 UTC m=+3327.904266629" watchObservedRunningTime="2026-07-28 13:46:40.977588298 +0000 UTC m=+3327.906872215"
Jul 28 13:46:41.961609 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:41.961574    2567 generic.go:356] "Generic (PLEG): container finished" podID="3571ccb3-d78e-4f61-9989-a3e5fa69ec4e" containerID="bbe47dabc623d94786bd9e209be8c73dc23e2a626911aea3f6bd1f176ee39bdb" exitCode=0
Jul 28 13:46:41.962077 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:41.961658    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h" event={"ID":"3571ccb3-d78e-4f61-9989-a3e5fa69ec4e","Type":"ContainerDied","Data":"bbe47dabc623d94786bd9e209be8c73dc23e2a626911aea3f6bd1f176ee39bdb"}
Jul 28 13:46:43.118938 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:43.118901    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"
Jul 28 13:46:43.271494 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:43.271458    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3571ccb3-d78e-4f61-9989-a3e5fa69ec4e-maas-api-service-ca\") pod \"3571ccb3-d78e-4f61-9989-a3e5fa69ec4e\" (UID: \"3571ccb3-d78e-4f61-9989-a3e5fa69ec4e\") "
Jul 28 13:46:43.271839 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:43.271816    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3571ccb3-d78e-4f61-9989-a3e5fa69ec4e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3571ccb3-d78e-4f61-9989-a3e5fa69ec4e" (UID: "3571ccb3-d78e-4f61-9989-a3e5fa69ec4e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:46:43.372428 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:43.372391    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3571ccb3-d78e-4f61-9989-a3e5fa69ec4e-maas-api-service-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:43.975700 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:43.975670    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"
Jul 28 13:46:43.975884 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:43.975666    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h" event={"ID":"3571ccb3-d78e-4f61-9989-a3e5fa69ec4e","Type":"ContainerDied","Data":"b1e378b1a931e799e215554c15d751e58cf951630d3eec9805d311f757cd0a14"}
Jul 28 13:46:43.975884 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:43.975798    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1e378b1a931e799e215554c15d751e58cf951630d3eec9805d311f757cd0a14"
Jul 28 13:46:56.000811 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.000768    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:56.006532 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.006506    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v"]
Jul 28 13:46:56.016046 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.016017    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-15d223-29754105-vhc9v"]
Jul 28 13:46:56.083114 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.083082    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"]
Jul 28 13:46:56.083356 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.083296    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb" podUID="a95b6ed3-eceb-44bf-90e5-f5c647729595" containerName="payload-processing" containerID="cri-o://303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3" gracePeriod=30
Jul 28 13:46:56.105671 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.105642    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"]
Jul 28 13:46:56.105955 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.105894    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg" podUID="2b84a497-e556-4560-9129-4e88da97f739" containerName="payload-pre-processing" containerID="cri-o://3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4" gracePeriod=30
Jul 28 13:46:56.164445 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.164416    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:56.317454 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.317393    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:56.407027 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.407000    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:46:56.409783 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.409763    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:46:56.488412 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.488370    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b84a497-e556-4560-9129-4e88da97f739-plugins-config-volume\") pod \"2b84a497-e556-4560-9129-4e88da97f739\" (UID: \"2b84a497-e556-4560-9129-4e88da97f739\") "
Jul 28 13:46:56.488621 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.488484    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t44jx\" (UniqueName: \"kubernetes.io/projected/a95b6ed3-eceb-44bf-90e5-f5c647729595-kube-api-access-t44jx\") pod \"a95b6ed3-eceb-44bf-90e5-f5c647729595\" (UID: \"a95b6ed3-eceb-44bf-90e5-f5c647729595\") "
Jul 28 13:46:56.488621 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.488524    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95b6ed3-eceb-44bf-90e5-f5c647729595-plugins-config-volume\") pod \"a95b6ed3-eceb-44bf-90e5-f5c647729595\" (UID: \"a95b6ed3-eceb-44bf-90e5-f5c647729595\") "
Jul 28 13:46:56.488621 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.488599    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db6nw\" (UniqueName: \"kubernetes.io/projected/2b84a497-e556-4560-9129-4e88da97f739-kube-api-access-db6nw\") pod \"2b84a497-e556-4560-9129-4e88da97f739\" (UID: \"2b84a497-e556-4560-9129-4e88da97f739\") "
Jul 28 13:46:56.488973 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.488949    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b84a497-e556-4560-9129-4e88da97f739-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2b84a497-e556-4560-9129-4e88da97f739" (UID: "2b84a497-e556-4560-9129-4e88da97f739"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:46:56.489067 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.488997    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a95b6ed3-eceb-44bf-90e5-f5c647729595-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a95b6ed3-eceb-44bf-90e5-f5c647729595" (UID: "a95b6ed3-eceb-44bf-90e5-f5c647729595"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:46:56.489067 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.489025    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"]
Jul 28 13:46:56.490642 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.490623    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b84a497-e556-4560-9129-4e88da97f739-kube-api-access-db6nw" (OuterVolumeSpecName: "kube-api-access-db6nw") pod "2b84a497-e556-4560-9129-4e88da97f739" (UID: "2b84a497-e556-4560-9129-4e88da97f739"). InnerVolumeSpecName "kube-api-access-db6nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:46:56.490719 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.490650    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95b6ed3-eceb-44bf-90e5-f5c647729595-kube-api-access-t44jx" (OuterVolumeSpecName: "kube-api-access-t44jx") pod "a95b6ed3-eceb-44bf-90e5-f5c647729595" (UID: "a95b6ed3-eceb-44bf-90e5-f5c647729595"). InnerVolumeSpecName "kube-api-access-t44jx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:46:56.506712 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.506682    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-15d223-lz98h"]
Jul 28 13:46:56.589647 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.589550    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b84a497-e556-4560-9129-4e88da97f739-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:56.589647 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.589580    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t44jx\" (UniqueName: \"kubernetes.io/projected/a95b6ed3-eceb-44bf-90e5-f5c647729595-kube-api-access-t44jx\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:56.589647 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.589591    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95b6ed3-eceb-44bf-90e5-f5c647729595-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:56.589647 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.589601    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db6nw\" (UniqueName: \"kubernetes.io/projected/2b84a497-e556-4560-9129-4e88da97f739-kube-api-access-db6nw\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:46:56.768608 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.768572    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:56.931225 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:56.931129    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:46:57.054713 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.054674    2567 generic.go:356] "Generic (PLEG): container finished" podID="2b84a497-e556-4560-9129-4e88da97f739" containerID="3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4" exitCode=0
Jul 28 13:46:57.055218 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.054733    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"
Jul 28 13:46:57.055218 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.054767    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg" event={"ID":"2b84a497-e556-4560-9129-4e88da97f739","Type":"ContainerDied","Data":"3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4"}
Jul 28 13:46:57.055218 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.054827    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg" event={"ID":"2b84a497-e556-4560-9129-4e88da97f739","Type":"ContainerDied","Data":"bca084b6ff2d9df72365ad853f4b6f237f379882676d9ef10da38608147be6ec"}
Jul 28 13:46:57.055218 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.054854    2567 scope.go:117] "RemoveContainer" containerID="3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4"
Jul 28 13:46:57.056299 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.056271    2567 generic.go:356] "Generic (PLEG): container finished" podID="a95b6ed3-eceb-44bf-90e5-f5c647729595" containerID="303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3" exitCode=0
Jul 28 13:46:57.056408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.056330    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb" event={"ID":"a95b6ed3-eceb-44bf-90e5-f5c647729595","Type":"ContainerDied","Data":"303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3"}
Jul 28 13:46:57.056408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.056345    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"
Jul 28 13:46:57.056408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.056376    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb" event={"ID":"a95b6ed3-eceb-44bf-90e5-f5c647729595","Type":"ContainerDied","Data":"38234da3bc943f6a2c3fc74da5082002579b410535193ede74a26b1985748da0"}
Jul 28 13:46:57.068567 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.067835    2567 scope.go:117] "RemoveContainer" containerID="3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4"
Jul 28 13:46:57.069074 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:46:57.069021    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4\": container with ID starting with 3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4 not found: ID does not exist" containerID="3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4"
Jul 28 13:46:57.069074 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.069065    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4"} err="failed to get container status \"3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4\": rpc error: code = NotFound desc = could not find container \"3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4\": container with ID starting with 3195926c1767ccbace646347e101f0876cb75ee94cfc14c1a9eb05bc956e46c4 not found: ID does not exist"
Jul 28 13:46:57.069074 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.069092    2567 scope.go:117] "RemoveContainer" containerID="303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3"
Jul 28 13:46:57.079613 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.079584    2567 scope.go:117] "RemoveContainer" containerID="303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3"
Jul 28 13:46:57.079966 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:46:57.079944    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3\": container with ID starting with 303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3 not found: ID does not exist" containerID="303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3"
Jul 28 13:46:57.080054 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.079975    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3"} err="failed to get container status \"303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3\": rpc error: code = NotFound desc = could not find container \"303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3\": container with ID starting with 303bc14b4834e428b885bc41e82b5027690da9cefd6391014ff8f13ea2141bb3 not found: ID does not exist"
Jul 28 13:46:57.123604 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.123572    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"]
Jul 28 13:46:57.137266 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.137230    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-15d223-757bcc4b4-fvvxb"]
Jul 28 13:46:57.160592 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.160555    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"]
Jul 28 13:46:57.169719 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.169684    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-15d223-5bd8db8668-jj4dg"]
Jul 28 13:46:57.502733 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.502700    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b84a497-e556-4560-9129-4e88da97f739" path="/var/lib/kubelet/pods/2b84a497-e556-4560-9129-4e88da97f739/volumes"
Jul 28 13:46:57.503055 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.503041    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3571ccb3-d78e-4f61-9989-a3e5fa69ec4e" path="/var/lib/kubelet/pods/3571ccb3-d78e-4f61-9989-a3e5fa69ec4e/volumes"
Jul 28 13:46:57.503287 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.503275    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8988ac05-d28d-4182-b6f4-cabf3578d92b" path="/var/lib/kubelet/pods/8988ac05-d28d-4182-b6f4-cabf3578d92b/volumes"
Jul 28 13:46:57.503552 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:57.503541    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95b6ed3-eceb-44bf-90e5-f5c647729595" path="/var/lib/kubelet/pods/a95b6ed3-eceb-44bf-90e5-f5c647729595/volumes"
Jul 28 13:46:58.413861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:46:58.413819    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:01.978154 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:01.978104    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:20.038275 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:20.038236    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:22.121750 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:22.121717    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:28.020654 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:28.020617    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:28.121861 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:28.121819    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:28.311638 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:28.311540    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:28.544004 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:28.543966    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:33.787061 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:33.787015    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:33.820537 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:33.820501    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"]
Jul 28 13:47:33.820817 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:33.820792    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2" podUID="818d7499-052a-49d0-84f3-4735cf0207b9" containerName="payload-processing" containerID="cri-o://1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6" gracePeriod=30
Jul 28 13:47:33.881738 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:33.881707    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:33.980579 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:33.980492    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:34.051649 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.051554    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:34.088931 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.088888    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:47:34.148063 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.148025    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/818d7499-052a-49d0-84f3-4735cf0207b9-plugins-config-volume\") pod \"818d7499-052a-49d0-84f3-4735cf0207b9\" (UID: \"818d7499-052a-49d0-84f3-4735cf0207b9\") "
Jul 28 13:47:34.148247 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.148111    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwjx9\" (UniqueName: \"kubernetes.io/projected/818d7499-052a-49d0-84f3-4735cf0207b9-kube-api-access-wwjx9\") pod \"818d7499-052a-49d0-84f3-4735cf0207b9\" (UID: \"818d7499-052a-49d0-84f3-4735cf0207b9\") "
Jul 28 13:47:34.148481 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.148454    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/818d7499-052a-49d0-84f3-4735cf0207b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "818d7499-052a-49d0-84f3-4735cf0207b9" (UID: "818d7499-052a-49d0-84f3-4735cf0207b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:47:34.150604 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.150577    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/818d7499-052a-49d0-84f3-4735cf0207b9-kube-api-access-wwjx9" (OuterVolumeSpecName: "kube-api-access-wwjx9") pod "818d7499-052a-49d0-84f3-4735cf0207b9" (UID: "818d7499-052a-49d0-84f3-4735cf0207b9"). InnerVolumeSpecName "kube-api-access-wwjx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:47:34.249728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.249694    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwjx9\" (UniqueName: \"kubernetes.io/projected/818d7499-052a-49d0-84f3-4735cf0207b9-kube-api-access-wwjx9\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:47:34.249728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.249721    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/818d7499-052a-49d0-84f3-4735cf0207b9-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:47:34.277705 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.277668    2567 generic.go:356] "Generic (PLEG): container finished" podID="818d7499-052a-49d0-84f3-4735cf0207b9" containerID="1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6" exitCode=0
Jul 28 13:47:34.277910 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.277714    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"
Jul 28 13:47:34.277910 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.277750    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2" event={"ID":"818d7499-052a-49d0-84f3-4735cf0207b9","Type":"ContainerDied","Data":"1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6"}
Jul 28 13:47:34.277910 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.277804    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2" event={"ID":"818d7499-052a-49d0-84f3-4735cf0207b9","Type":"ContainerDied","Data":"8246f41f917970b96e81c5fa5531d09fdd49e91ef7c474a436b26c71c7446fcf"}
Jul 28 13:47:34.277910 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.277827    2567 scope.go:117] "RemoveContainer" containerID="1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6"
Jul 28 13:47:34.287676 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.287655    2567 scope.go:117] "RemoveContainer" containerID="1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6"
Jul 28 13:47:34.287989 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:47:34.287969    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6\": container with ID starting with 1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6 not found: ID does not exist" containerID="1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6"
Jul 28 13:47:34.288054 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.287999    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6"} err="failed to get container status \"1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6\": rpc error: code = NotFound desc = could not find container \"1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6\": container with ID starting with 1af92804a7081d0ed87241fb52b810a35a4caebc2c71fe4971641648e49e89b6 not found: ID does not exist"
Jul 28 13:47:34.304129 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.304051    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"]
Jul 28 13:47:34.306363 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.306344    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-220710-74b596bb84-8ffb2"]
Jul 28 13:47:34.395422 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:34.395391    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:35.501835 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:35.501802    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="818d7499-052a-49d0-84f3-4735cf0207b9" path="/var/lib/kubelet/pods/818d7499-052a-49d0-84f3-4735cf0207b9/volumes"
Jul 28 13:47:40.971557 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:40.971522    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:41.042401 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.042372    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:41.240367 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.240260    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:41.508937 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.508838    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:41.648009 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.647974    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"]
Jul 28 13:47:41.648379 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648367    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3571ccb3-d78e-4f61-9989-a3e5fa69ec4e" containerName="revoke-keys"
Jul 28 13:47:41.648427 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648380    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3571ccb3-d78e-4f61-9989-a3e5fa69ec4e" containerName="revoke-keys"
Jul 28 13:47:41.648427 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648395    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy"
Jul 28 13:47:41.648427 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648401    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="74a231c5-48b5-4fee-a49b-67024e274210" containerName="istio-proxy"
Jul 28 13:47:41.648427 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648412    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818d7499-052a-49d0-84f3-4735cf0207b9" containerName="payload-processing"
Jul 28 13:47:41.648427 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648417    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="818d7499-052a-49d0-84f3-4735cf0207b9" containerName="payload-processing"
Jul 28 13:47:41.648427 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648424    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b84a497-e556-4560-9129-4e88da97f739" containerName="payload-pre-processing"
Jul 28 13:47:41.648610 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648431    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b84a497-e556-4560-9129-4e88da97f739" containerName="payload-pre-processing"
Jul 28 13:47:41.648610 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648445    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95b6ed3-eceb-44bf-90e5-f5c647729595" containerName="payload-processing"
Jul 28 13:47:41.648610 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648450    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95b6ed3-eceb-44bf-90e5-f5c647729595" containerName="payload-processing"
Jul 28 13:47:41.648610 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648508    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b84a497-e556-4560-9129-4e88da97f739" containerName="payload-pre-processing"
Jul 28 13:47:41.648610 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648515    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95b6ed3-eceb-44bf-90e5-f5c647729595" containerName="payload-processing"
Jul 28 13:47:41.648610 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648522    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3571ccb3-d78e-4f61-9989-a3e5fa69ec4e" containerName="revoke-keys"
Jul 28 13:47:41.648610 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.648530    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="818d7499-052a-49d0-84f3-4735cf0207b9" containerName="payload-processing"
Jul 28 13:47:41.652953 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.652905    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"
Jul 28 13:47:41.655751 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.655728    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 13:47:41.655883 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.655732    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z6qfh\""
Jul 28 13:47:41.664317 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.664289    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"]
Jul 28 13:47:41.721978 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.721943    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb2508f8-4ef3-4aa6-8c97-10912d224d7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7\" (UID: \"eb2508f8-4ef3-4aa6-8c97-10912d224d7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"
Jul 28 13:47:41.823188 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.823150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb2508f8-4ef3-4aa6-8c97-10912d224d7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7\" (UID: \"eb2508f8-4ef3-4aa6-8c97-10912d224d7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"
Jul 28 13:47:41.823819 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.823798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb2508f8-4ef3-4aa6-8c97-10912d224d7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7\" (UID: \"eb2508f8-4ef3-4aa6-8c97-10912d224d7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"
Jul 28 13:47:41.964631 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:41.964591    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"
Jul 28 13:47:42.114016 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:42.113987    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"]
Jul 28 13:47:42.116274 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:47:42.116241    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2508f8_4ef3_4aa6_8c97_10912d224d7b.slice/crio-16f228157414e9bf8b67da6c807d846b0238054944b7eda4b551525bd222604b WatchSource:0}: Error finding container 16f228157414e9bf8b67da6c807d846b0238054944b7eda4b551525bd222604b: Status 404 returned error can't find the container with id 16f228157414e9bf8b67da6c807d846b0238054944b7eda4b551525bd222604b
Jul 28 13:47:42.333483 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:42.333439    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7" event={"ID":"eb2508f8-4ef3-4aa6-8c97-10912d224d7b","Type":"ContainerStarted","Data":"16f228157414e9bf8b67da6c807d846b0238054944b7eda4b551525bd222604b"}
Jul 28 13:47:43.341535 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:43.341500    2567 generic.go:356] "Generic (PLEG): container finished" podID="eb2508f8-4ef3-4aa6-8c97-10912d224d7b" containerID="ea275790e782693b0a26b1bbdeee4c6265af8620231091e3096cfab98a552efd" exitCode=0
Jul 28 13:47:43.341965 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:43.341574    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7" event={"ID":"eb2508f8-4ef3-4aa6-8c97-10912d224d7b","Type":"ContainerDied","Data":"ea275790e782693b0a26b1bbdeee4c6265af8620231091e3096cfab98a552efd"}
Jul 28 13:47:44.491494 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:44.491468    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"
Jul 28 13:47:44.551640 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:44.551609    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb2508f8-4ef3-4aa6-8c97-10912d224d7b-maas-api-service-ca\") pod \"eb2508f8-4ef3-4aa6-8c97-10912d224d7b\" (UID: \"eb2508f8-4ef3-4aa6-8c97-10912d224d7b\") "
Jul 28 13:47:44.552153 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:44.552127    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb2508f8-4ef3-4aa6-8c97-10912d224d7b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eb2508f8-4ef3-4aa6-8c97-10912d224d7b" (UID: "eb2508f8-4ef3-4aa6-8c97-10912d224d7b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:47:44.652711 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:44.652619    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb2508f8-4ef3-4aa6-8c97-10912d224d7b-maas-api-service-ca\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:47:45.356001 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:45.355963    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"
Jul 28 13:47:45.356184 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:45.355994    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7" event={"ID":"eb2508f8-4ef3-4aa6-8c97-10912d224d7b","Type":"ContainerDied","Data":"16f228157414e9bf8b67da6c807d846b0238054944b7eda4b551525bd222604b"}
Jul 28 13:47:45.356184 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:45.356048    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16f228157414e9bf8b67da6c807d846b0238054944b7eda4b551525bd222604b"
Jul 28 13:47:46.171344 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:46.171311    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:52.410679 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.410641    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"]
Jul 28 13:47:52.411841 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.411487    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx" podUID="42f057d9-9ea7-41d9-879d-8c84255f4177" containerName="payload-processing" containerID="cri-o://e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44" gracePeriod=30
Jul 28 13:47:52.416616 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.416584    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"]
Jul 28 13:47:52.416876 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.416848    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th" podUID="7a375373-7d92-49bd-a89d-e1250166d186" containerName="payload-pre-processing" containerID="cri-o://d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8" gracePeriod=30
Jul 28 13:47:52.576988 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.576951    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"]
Jul 28 13:47:52.582333 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.582300    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-2c9e23-qmzw7"]
Jul 28 13:47:52.715428 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.715400    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:47:52.718365 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.718340    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:47:52.829180 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.829148    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42f057d9-9ea7-41d9-879d-8c84255f4177-plugins-config-volume\") pod \"42f057d9-9ea7-41d9-879d-8c84255f4177\" (UID: \"42f057d9-9ea7-41d9-879d-8c84255f4177\") "
Jul 28 13:47:52.829400 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.829199    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fx6s\" (UniqueName: \"kubernetes.io/projected/7a375373-7d92-49bd-a89d-e1250166d186-kube-api-access-7fx6s\") pod \"7a375373-7d92-49bd-a89d-e1250166d186\" (UID: \"7a375373-7d92-49bd-a89d-e1250166d186\") "
Jul 28 13:47:52.829400 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.829277    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a375373-7d92-49bd-a89d-e1250166d186-plugins-config-volume\") pod \"7a375373-7d92-49bd-a89d-e1250166d186\" (UID: \"7a375373-7d92-49bd-a89d-e1250166d186\") "
Jul 28 13:47:52.829400 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.829301    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ktjh\" (UniqueName: \"kubernetes.io/projected/42f057d9-9ea7-41d9-879d-8c84255f4177-kube-api-access-9ktjh\") pod \"42f057d9-9ea7-41d9-879d-8c84255f4177\" (UID: \"42f057d9-9ea7-41d9-879d-8c84255f4177\") "
Jul 28 13:47:52.829728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.829673    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a375373-7d92-49bd-a89d-e1250166d186-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a375373-7d92-49bd-a89d-e1250166d186" (UID: "7a375373-7d92-49bd-a89d-e1250166d186"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:47:52.830001 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.829882    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42f057d9-9ea7-41d9-879d-8c84255f4177-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42f057d9-9ea7-41d9-879d-8c84255f4177" (UID: "42f057d9-9ea7-41d9-879d-8c84255f4177"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:47:52.831630 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.831603    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42f057d9-9ea7-41d9-879d-8c84255f4177-kube-api-access-9ktjh" (OuterVolumeSpecName: "kube-api-access-9ktjh") pod "42f057d9-9ea7-41d9-879d-8c84255f4177" (UID: "42f057d9-9ea7-41d9-879d-8c84255f4177"). InnerVolumeSpecName "kube-api-access-9ktjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:47:52.831822 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.831801    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a375373-7d92-49bd-a89d-e1250166d186-kube-api-access-7fx6s" (OuterVolumeSpecName: "kube-api-access-7fx6s") pod "7a375373-7d92-49bd-a89d-e1250166d186" (UID: "7a375373-7d92-49bd-a89d-e1250166d186"). InnerVolumeSpecName "kube-api-access-7fx6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:47:52.838740 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.838713    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:52.911390 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.911343    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:52.930728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.930635    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a375373-7d92-49bd-a89d-e1250166d186-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:47:52.930728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.930666    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ktjh\" (UniqueName: \"kubernetes.io/projected/42f057d9-9ea7-41d9-879d-8c84255f4177-kube-api-access-9ktjh\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:47:52.930728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.930680    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42f057d9-9ea7-41d9-879d-8c84255f4177-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:47:52.930728 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:52.930693    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fx6s\" (UniqueName: \"kubernetes.io/projected/7a375373-7d92-49bd-a89d-e1250166d186-kube-api-access-7fx6s\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:47:53.011455 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.011412    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:53.411527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.411491    2567 generic.go:356] "Generic (PLEG): container finished" podID="7a375373-7d92-49bd-a89d-e1250166d186" containerID="d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8" exitCode=0
Jul 28 13:47:53.412072 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.411541    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"
Jul 28 13:47:53.412072 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.411582    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th" event={"ID":"7a375373-7d92-49bd-a89d-e1250166d186","Type":"ContainerDied","Data":"d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8"}
Jul 28 13:47:53.412072 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.411644    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th" event={"ID":"7a375373-7d92-49bd-a89d-e1250166d186","Type":"ContainerDied","Data":"557b1e73819d35f88681205aa642058f35380b230fabda5f3a3a8684c676e2a8"}
Jul 28 13:47:53.412072 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.411682    2567 scope.go:117] "RemoveContainer" containerID="d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8"
Jul 28 13:47:53.413030 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.413009    2567 generic.go:356] "Generic (PLEG): container finished" podID="42f057d9-9ea7-41d9-879d-8c84255f4177" containerID="e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44" exitCode=0
Jul 28 13:47:53.413101 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.413058    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx" event={"ID":"42f057d9-9ea7-41d9-879d-8c84255f4177","Type":"ContainerDied","Data":"e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44"}
Jul 28 13:47:53.413101 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.413066    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"
Jul 28 13:47:53.413101 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.413094    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx" event={"ID":"42f057d9-9ea7-41d9-879d-8c84255f4177","Type":"ContainerDied","Data":"e1cd10fb7cc2a7284fab5f28f8d27492cdc476bbd7821659a358bec3b2d61339"}
Jul 28 13:47:53.436991 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.436967    2567 scope.go:117] "RemoveContainer" containerID="d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8"
Jul 28 13:47:53.437310 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:47:53.437292    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8\": container with ID starting with d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8 not found: ID does not exist" containerID="d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8"
Jul 28 13:47:53.437364 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.437318    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8"} err="failed to get container status \"d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8\": rpc error: code = NotFound desc = could not find container \"d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8\": container with ID starting with d765ca906841ea231e830fc8e81d734cc26638d35e90c4999a9927f74fab04f8 not found: ID does not exist"
Jul 28 13:47:53.437364 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.437336    2567 scope.go:117] "RemoveContainer" containerID="e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44"
Jul 28 13:47:53.446216 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.446196    2567 scope.go:117] "RemoveContainer" containerID="e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44"
Jul 28 13:47:53.446507 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:47:53.446485    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44\": container with ID starting with e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44 not found: ID does not exist" containerID="e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44"
Jul 28 13:47:53.446552 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.446515    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44"} err="failed to get container status \"e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44\": rpc error: code = NotFound desc = could not find container \"e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44\": container with ID starting with e45c673bad560306ebfe82d8e1b6d987f4a8900da73bd507b1044052104b8f44 not found: ID does not exist"
Jul 28 13:47:53.451856 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.451829    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"]
Jul 28 13:47:53.457824 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.457794    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-2c9e23-5498b74fc6-692th"]
Jul 28 13:47:53.475149 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.475118    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"]
Jul 28 13:47:53.487531 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.487499    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-2c9e23-67fd5dbb5d-467nx"]
Jul 28 13:47:53.501496 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.501467    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42f057d9-9ea7-41d9-879d-8c84255f4177" path="/var/lib/kubelet/pods/42f057d9-9ea7-41d9-879d-8c84255f4177/volumes"
Jul 28 13:47:53.501836 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.501824    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a375373-7d92-49bd-a89d-e1250166d186" path="/var/lib/kubelet/pods/7a375373-7d92-49bd-a89d-e1250166d186/volumes"
Jul 28 13:47:53.502165 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:53.502151    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb2508f8-4ef3-4aa6-8c97-10912d224d7b" path="/var/lib/kubelet/pods/eb2508f8-4ef3-4aa6-8c97-10912d224d7b/volumes"
Jul 28 13:47:57.348772 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:57.348734    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:59.466846 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:59.466810    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:59.547075 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:59.547038    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:47:59.741911 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:59.741823    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"]
Jul 28 13:47:59.742082 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:59.742058    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy" containerID="cri-o://523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001" gracePeriod=30
Jul 28 13:47:59.760050 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:47:59.760019    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:00.000674 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:00.000560    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:04.228864 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:04.228828    2567 patch_prober.go:28] interesting pod/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 13:48:04.229284 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:04.228943    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 13:48:05.009402 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.009328    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:48:05.147578 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.147492    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36b19614-dd11-478a-8da1-53099bec8de5-istio-podinfo\") pod \"36b19614-dd11-478a-8da1-53099bec8de5\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") "
Jul 28 13:48:05.147578 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.147556    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-data\") pod \"36b19614-dd11-478a-8da1-53099bec8de5\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") "
Jul 28 13:48:05.147819 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.147584    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txzpb\" (UniqueName: \"kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-kube-api-access-txzpb\") pod \"36b19614-dd11-478a-8da1-53099bec8de5\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") "
Jul 28 13:48:05.147819 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.147734    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36b19614-dd11-478a-8da1-53099bec8de5-istiod-ca-cert\") pod \"36b19614-dd11-478a-8da1-53099bec8de5\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") "
Jul 28 13:48:05.147819 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.147800    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-socket\") pod \"36b19614-dd11-478a-8da1-53099bec8de5\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") "
Jul 28 13:48:05.148027 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.147837    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-certs\") pod \"36b19614-dd11-478a-8da1-53099bec8de5\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") "
Jul 28 13:48:05.148027 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.147868    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-credential-socket\") pod \"36b19614-dd11-478a-8da1-53099bec8de5\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") "
Jul 28 13:48:05.148027 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.147893    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-envoy\") pod \"36b19614-dd11-478a-8da1-53099bec8de5\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") "
Jul 28 13:48:05.148027 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.147985    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-istio-token\") pod \"36b19614-dd11-478a-8da1-53099bec8de5\" (UID: \"36b19614-dd11-478a-8da1-53099bec8de5\") "
Jul 28 13:48:05.148219 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.148031    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "36b19614-dd11-478a-8da1-53099bec8de5" (UID: "36b19614-dd11-478a-8da1-53099bec8de5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:48:05.148219 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.148153    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "36b19614-dd11-478a-8da1-53099bec8de5" (UID: "36b19614-dd11-478a-8da1-53099bec8de5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:48:05.148219 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.148199    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "36b19614-dd11-478a-8da1-53099bec8de5" (UID: "36b19614-dd11-478a-8da1-53099bec8de5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:48:05.148383 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.148217    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36b19614-dd11-478a-8da1-53099bec8de5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "36b19614-dd11-478a-8da1-53099bec8de5" (UID: "36b19614-dd11-478a-8da1-53099bec8de5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:48:05.148383 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.148372    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36b19614-dd11-478a-8da1-53099bec8de5-istiod-ca-cert\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:05.148488 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.148387    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:05.148488 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.148400    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-workload-certs\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:05.148488 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.148413    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-credential-socket\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:05.148737 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.148699    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-data" (OuterVolumeSpecName: "istio-data") pod "36b19614-dd11-478a-8da1-53099bec8de5" (UID: "36b19614-dd11-478a-8da1-53099bec8de5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:48:05.149875 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.149841    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36b19614-dd11-478a-8da1-53099bec8de5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "36b19614-dd11-478a-8da1-53099bec8de5" (UID: "36b19614-dd11-478a-8da1-53099bec8de5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 13:48:05.150036 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.149891    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-kube-api-access-txzpb" (OuterVolumeSpecName: "kube-api-access-txzpb") pod "36b19614-dd11-478a-8da1-53099bec8de5" (UID: "36b19614-dd11-478a-8da1-53099bec8de5"). InnerVolumeSpecName "kube-api-access-txzpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:48:05.150508 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.150486    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-istio-token" (OuterVolumeSpecName: "istio-token") pod "36b19614-dd11-478a-8da1-53099bec8de5" (UID: "36b19614-dd11-478a-8da1-53099bec8de5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:48:05.150508 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.150488    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "36b19614-dd11-478a-8da1-53099bec8de5" (UID: "36b19614-dd11-478a-8da1-53099bec8de5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 13:48:05.249857 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.249817    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36b19614-dd11-478a-8da1-53099bec8de5-istio-podinfo\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:05.249857 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.249848    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-data\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:05.249857 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.249858    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txzpb\" (UniqueName: \"kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-kube-api-access-txzpb\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:05.249857 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.249868    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36b19614-dd11-478a-8da1-53099bec8de5-istio-envoy\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:05.250414 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.249876    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36b19614-dd11-478a-8da1-53099bec8de5-istio-token\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:05.489239 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.489204    2567 generic.go:356] "Generic (PLEG): container finished" podID="36b19614-dd11-478a-8da1-53099bec8de5" containerID="523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001" exitCode=0
Jul 28 13:48:05.489420 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.489251    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"
Jul 28 13:48:05.489420 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.489277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" event={"ID":"36b19614-dd11-478a-8da1-53099bec8de5","Type":"ContainerDied","Data":"523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001"}
Jul 28 13:48:05.489420 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.489346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv" event={"ID":"36b19614-dd11-478a-8da1-53099bec8de5","Type":"ContainerDied","Data":"c086e086b9deaf8b7a256191f6cc3cdec6f6e82fba63dde9e3b4eb8ff5a8e4f5"}
Jul 28 13:48:05.489420 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.489367    2567 scope.go:117] "RemoveContainer" containerID="523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001"
Jul 28 13:48:05.499700 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.499677    2567 scope.go:117] "RemoveContainer" containerID="77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e"
Jul 28 13:48:05.508946 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.508900    2567 scope.go:117] "RemoveContainer" containerID="523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001"
Jul 28 13:48:05.509261 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:48:05.509241    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001\": container with ID starting with 523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001 not found: ID does not exist" containerID="523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001"
Jul 28 13:48:05.509323 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.509270    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001"} err="failed to get container status \"523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001\": rpc error: code = NotFound desc = could not find container \"523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001\": container with ID starting with 523f4f424d7cb0430b4f31c89c7cb90022f937e626caec115a6afee6e5bd8001 not found: ID does not exist"
Jul 28 13:48:05.509323 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.509290    2567 scope.go:117] "RemoveContainer" containerID="77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e"
Jul 28 13:48:05.509574 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:48:05.509555    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e\": container with ID starting with 77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e not found: ID does not exist" containerID="77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e"
Jul 28 13:48:05.509635 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.509579    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e"} err="failed to get container status \"77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e\": rpc error: code = NotFound desc = could not find container \"77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e\": container with ID starting with 77341a57f692f131eb337fe3582e3dbe8bf9cf1e4c9409944ef506626685d60e not found: ID does not exist"
Jul 28 13:48:05.514221 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.514195    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"]
Jul 28 13:48:05.519662 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:05.519638    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-2c9e23-openshift-default-dfb77859b-bcltv"]
Jul 28 13:48:07.500993 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:07.500958    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b19614-dd11-478a-8da1-53099bec8de5" path="/var/lib/kubelet/pods/36b19614-dd11-478a-8da1-53099bec8de5/volumes"
Jul 28 13:48:10.743043 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:10.743002    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:10.757688 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:10.757658    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"]
Jul 28 13:48:10.757976 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:10.757946    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k" podUID="d1c3111d-2256-4b41-84d9-f43bbb26bab7" containerName="payload-processing" containerID="cri-o://23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e" gracePeriod=30
Jul 28 13:48:11.021970 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.021942    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:48:11.098292 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.098256    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1c3111d-2256-4b41-84d9-f43bbb26bab7-plugins-config-volume\") pod \"d1c3111d-2256-4b41-84d9-f43bbb26bab7\" (UID: \"d1c3111d-2256-4b41-84d9-f43bbb26bab7\") "
Jul 28 13:48:11.098462 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.098337    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl8wx\" (UniqueName: \"kubernetes.io/projected/d1c3111d-2256-4b41-84d9-f43bbb26bab7-kube-api-access-rl8wx\") pod \"d1c3111d-2256-4b41-84d9-f43bbb26bab7\" (UID: \"d1c3111d-2256-4b41-84d9-f43bbb26bab7\") "
Jul 28 13:48:11.098718 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.098688    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1c3111d-2256-4b41-84d9-f43bbb26bab7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d1c3111d-2256-4b41-84d9-f43bbb26bab7" (UID: "d1c3111d-2256-4b41-84d9-f43bbb26bab7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 13:48:11.100388 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.100366    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1c3111d-2256-4b41-84d9-f43bbb26bab7-kube-api-access-rl8wx" (OuterVolumeSpecName: "kube-api-access-rl8wx") pod "d1c3111d-2256-4b41-84d9-f43bbb26bab7" (UID: "d1c3111d-2256-4b41-84d9-f43bbb26bab7"). InnerVolumeSpecName "kube-api-access-rl8wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 13:48:11.199140 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.199102    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl8wx\" (UniqueName: \"kubernetes.io/projected/d1c3111d-2256-4b41-84d9-f43bbb26bab7-kube-api-access-rl8wx\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:11.199140 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.199131    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1c3111d-2256-4b41-84d9-f43bbb26bab7-plugins-config-volume\") on node \"ip-10-0-133-173.ec2.internal\" DevicePath \"\""
Jul 28 13:48:11.524259 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.524226    2567 generic.go:356] "Generic (PLEG): container finished" podID="d1c3111d-2256-4b41-84d9-f43bbb26bab7" containerID="23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e" exitCode=0
Jul 28 13:48:11.524396 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.524273    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"
Jul 28 13:48:11.524396 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.524310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k" event={"ID":"d1c3111d-2256-4b41-84d9-f43bbb26bab7","Type":"ContainerDied","Data":"23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e"}
Jul 28 13:48:11.524396 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.524366    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k" event={"ID":"d1c3111d-2256-4b41-84d9-f43bbb26bab7","Type":"ContainerDied","Data":"04c5d5c2e02586b793f6c5a3d29165e7fee0dd51c3a9d4dc2ed3eb975bc60e4a"}
Jul 28 13:48:11.524396 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.524391    2567 scope.go:117] "RemoveContainer" containerID="23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e"
Jul 28 13:48:11.534622 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.534593    2567 scope.go:117] "RemoveContainer" containerID="23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e"
Jul 28 13:48:11.535015 ip-10-0-133-173 kubenswrapper[2567]: E0728 13:48:11.534985    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e\": container with ID starting with 23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e not found: ID does not exist" containerID="23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e"
Jul 28 13:48:11.535164 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.535027    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e"} err="failed to get container status \"23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e\": rpc error: code = NotFound desc = could not find container \"23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e\": container with ID starting with 23849d94943f885eac9b801ddcce56d6bb359d04561795cebba283a1d3374e0e not found: ID does not exist"
Jul 28 13:48:11.545606 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.545573    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"]
Jul 28 13:48:11.557160 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.557130    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-8fd168-58954778d6-f9j5k"]
Jul 28 13:48:11.634463 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:11.634423    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:12.577767 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:12.577722    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:13.501849 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:13.501814    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1c3111d-2256-4b41-84d9-f43bbb26bab7" path="/var/lib/kubelet/pods/d1c3111d-2256-4b41-84d9-f43bbb26bab7/volumes"
Jul 28 13:48:17.985517 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:17.985469    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:18.091741 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:18.091702    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:18.389825 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:18.389795    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:18.635504 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:18.635464    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:19.193150 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:19.193113    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59bd69798f-j97ll_ee3712b4-2b15-4adc-8d0d-10bfbe516014/authorino/0.log"
Jul 28 13:48:22.134013 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:22.133932    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:26.249093 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:26.249049    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9zqxq_80b60f4e-b14d-4c03-a656-ba6a548e9242/manager/0.log"
Jul 28 13:48:26.379756 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:26.379707    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kjhqq_0b964906-db9c-46da-96c8-e0270325bbfa/manager/0.log"
Jul 28 13:48:26.642359 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:26.642331    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cnl26_b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1/server/0.log"
Jul 28 13:48:26.770941 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:26.770889    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bfrws_694cbac9-329f-438d-8b6b-37cc0bf513f9/manager/0.log"
Jul 28 13:48:27.154048 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:27.154021    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bb544cf8-qnv86_9c3687a8-4991-4a6c-a90c-c026c4ee93b9/copy-manifests/0.log"
Jul 28 13:48:27.174940 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:27.174889    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bb544cf8-qnv86_9c3687a8-4991-4a6c-a90c-c026c4ee93b9/manager/0.log"
Jul 28 13:48:27.649799 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:27.649771    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754075-hvqw5_3b7d4489-6133-4e4a-bfdc-b7033e441570/cleanup/0.log"
Jul 28 13:48:27.770742 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:27.770714    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754090-fvlht_ee889193-a134-4c82-a82d-cbb7429469b8/cleanup/0.log"
Jul 28 13:48:28.145621 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:28.145583    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:28.819278 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:28.819247    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx_b582cfbb-baee-4a62-b902-0bf98c8e462d/util/0.log"
Jul 28 13:48:28.826551 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:28.826524    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx_b582cfbb-baee-4a62-b902-0bf98c8e462d/pull/0.log"
Jul 28 13:48:28.836971 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:28.836928    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx_b582cfbb-baee-4a62-b902-0bf98c8e462d/extract/0.log"
Jul 28 13:48:28.946664 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:28.946629    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v_a6870421-30a2-4834-acd1-df2c2c434dfa/extract/0.log"
Jul 28 13:48:28.953527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:28.953496    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v_a6870421-30a2-4834-acd1-df2c2c434dfa/util/0.log"
Jul 28 13:48:28.960798 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:28.960771    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v_a6870421-30a2-4834-acd1-df2c2c434dfa/pull/0.log"
Jul 28 13:48:29.076711 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:29.076623    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69_7387b635-9d62-43eb-91c6-26a2ccce613c/util/0.log"
Jul 28 13:48:29.084060 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:29.084033    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69_7387b635-9d62-43eb-91c6-26a2ccce613c/pull/0.log"
Jul 28 13:48:29.091797 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:29.091767    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69_7387b635-9d62-43eb-91c6-26a2ccce613c/extract/0.log"
Jul 28 13:48:29.213727 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:29.213695    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89_57d0f186-5a36-4b9d-b0ff-621ba3080078/util/0.log"
Jul 28 13:48:29.221189 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:29.221160    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89_57d0f186-5a36-4b9d-b0ff-621ba3080078/pull/0.log"
Jul 28 13:48:29.228224 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:29.228194    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89_57d0f186-5a36-4b9d-b0ff-621ba3080078/extract/0.log"
Jul 28 13:48:29.372511 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:29.372412    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59bd69798f-j97ll_ee3712b4-2b15-4adc-8d0d-10bfbe516014/authorino/0.log"
Jul 28 13:48:29.613058 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:29.613030    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gndgl_0822558b-d534-4819-9a01-d1f9c54605fc/manager/0.log"
Jul 28 13:48:29.742452 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:29.742371    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-w58qr_85b736e1-6fa2-4c12-a4ef-9936d4dec9ab/kuadrant-console-plugin/0.log"
Jul 28 13:48:29.871022 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:29.870994    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k8dq6_fde928d7-a768-4992-a103-805c3fd5a836/registry-server/0.log"
Jul 28 13:48:30.003657 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:30.003567    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tc5zp_2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d/manager/0.log"
Jul 28 13:48:30.261017 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:30.260873    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8j84s_4a640983-f718-4fda-a711-d42d3ec5a0e0/manager/0.log"
Jul 28 13:48:30.640079 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:30.640048    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p_338c18b9-7653-48cf-8e72-001f509376cf/istio-proxy/0.log"
Jul 28 13:48:30.885682 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:30.885649    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7897958f89-6zbsc_d364df40-37fc-4ecb-b7fa-a84fd7d3afa5/kube-auth-proxy/0.log"
Jul 28 13:48:31.189979 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:31.189946    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zk8s8_da01587a-958c-4fa8-858c-8baae2332d54/istio-proxy/1.log"
Jul 28 13:48:31.357573 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:31.357539    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-rqvtg_97b468fc-bad3-458f-accb-86c8cfdcb950/payload-pre-processing/0.log"
Jul 28 13:48:32.258975 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:32.258914    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cbchg_e5b7f31e-92b9-4b2e-99c9-9b6bfb7d80de/main/0.log"
Jul 28 13:48:32.517784 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:32.517744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4rkhc_f511f145-3a11-4b5f-8a0f-1cdbc7ab2f86/main/0.log"
Jul 28 13:48:40.288591 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:40.288558    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:42.925180 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:42.925144    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log" limit=1024
Jul 28 13:48:43.523887 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:43.523849    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-smsrp_8e112889-b95e-488a-b6f7-4b30b5253836/global-pull-secret-syncer/0.log"
Jul 28 13:48:43.589647 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:43.589621    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6pcqf_01ebce22-4e32-402d-98a7-351b2b60f3c5/konnectivity-agent/0.log"
Jul 28 13:48:43.735671 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:43.735620    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-173.ec2.internal_7aef2ed6ac42d45c959a5cf3a54001f5/haproxy/0.log"
Jul 28 13:48:47.952073 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:47.952036    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx_b582cfbb-baee-4a62-b902-0bf98c8e462d/extract/0.log"
Jul 28 13:48:47.978867 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:47.978835    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx_b582cfbb-baee-4a62-b902-0bf98c8e462d/util/0.log"
Jul 28 13:48:48.011193 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.011161    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75979gbx_b582cfbb-baee-4a62-b902-0bf98c8e462d/pull/0.log"
Jul 28 13:48:48.046443 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.046407    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v_a6870421-30a2-4834-acd1-df2c2c434dfa/extract/0.log"
Jul 28 13:48:48.081628 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.081599    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v_a6870421-30a2-4834-acd1-df2c2c434dfa/util/0.log"
Jul 28 13:48:48.116393 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.116357    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fz99v_a6870421-30a2-4834-acd1-df2c2c434dfa/pull/0.log"
Jul 28 13:48:48.150831 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.150805    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69_7387b635-9d62-43eb-91c6-26a2ccce613c/extract/0.log"
Jul 28 13:48:48.178092 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.178053    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69_7387b635-9d62-43eb-91c6-26a2ccce613c/util/0.log"
Jul 28 13:48:48.201054 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.201027    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73jcv69_7387b635-9d62-43eb-91c6-26a2ccce613c/pull/0.log"
Jul 28 13:48:48.231583 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.231491    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89_57d0f186-5a36-4b9d-b0ff-621ba3080078/extract/0.log"
Jul 28 13:48:48.256502 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.256478    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89_57d0f186-5a36-4b9d-b0ff-621ba3080078/util/0.log"
Jul 28 13:48:48.282536 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.282504    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15gw89_57d0f186-5a36-4b9d-b0ff-621ba3080078/pull/0.log"
Jul 28 13:48:48.946825 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:48.946790    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-59bd69798f-j97ll_ee3712b4-2b15-4adc-8d0d-10bfbe516014/authorino/0.log"
Jul 28 13:48:49.023249 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:49.023214    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gndgl_0822558b-d534-4819-9a01-d1f9c54605fc/manager/0.log"
Jul 28 13:48:49.053714 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:49.053686    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-w58qr_85b736e1-6fa2-4c12-a4ef-9936d4dec9ab/kuadrant-console-plugin/0.log"
Jul 28 13:48:49.119597 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:49.119562    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-k8dq6_fde928d7-a768-4992-a103-805c3fd5a836/registry-server/0.log"
Jul 28 13:48:49.320029 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:49.319994    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tc5zp_2dd5b480-9d3a-4f0b-b54a-99fee89d5c9d/manager/0.log"
Jul 28 13:48:49.465137 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:49.465106    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8j84s_4a640983-f718-4fda-a711-d42d3ec5a0e0/manager/0.log"
Jul 28 13:48:51.608024 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:51.607982    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qw89_49e706ca-ba20-40b3-a0d5-9af3d30639aa/node-exporter/0.log"
Jul 28 13:48:51.635636 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:51.635605    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qw89_49e706ca-ba20-40b3-a0d5-9af3d30639aa/kube-rbac-proxy/0.log"
Jul 28 13:48:51.667577 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:51.667551    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qw89_49e706ca-ba20-40b3-a0d5-9af3d30639aa/init-textfile/0.log"
Jul 28 13:48:53.391762 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.391729    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"]
Jul 28 13:48:53.392182 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392122    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy"
Jul 28 13:48:53.392182 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392135    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy"
Jul 28 13:48:53.392182 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392144    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb2508f8-4ef3-4aa6-8c97-10912d224d7b" containerName="revoke-keys"
Jul 28 13:48:53.392182 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392149    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb2508f8-4ef3-4aa6-8c97-10912d224d7b" containerName="revoke-keys"
Jul 28 13:48:53.392182 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392159    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42f057d9-9ea7-41d9-879d-8c84255f4177" containerName="payload-processing"
Jul 28 13:48:53.392182 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392166    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="42f057d9-9ea7-41d9-879d-8c84255f4177" containerName="payload-processing"
Jul 28 13:48:53.392182 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392181    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1c3111d-2256-4b41-84d9-f43bbb26bab7" containerName="payload-processing"
Jul 28 13:48:53.392408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392188    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1c3111d-2256-4b41-84d9-f43bbb26bab7" containerName="payload-processing"
Jul 28 13:48:53.392408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392195    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a375373-7d92-49bd-a89d-e1250166d186" containerName="payload-pre-processing"
Jul 28 13:48:53.392408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392200    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a375373-7d92-49bd-a89d-e1250166d186" containerName="payload-pre-processing"
Jul 28 13:48:53.392408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392273    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy"
Jul 28 13:48:53.392408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392281    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb2508f8-4ef3-4aa6-8c97-10912d224d7b" containerName="revoke-keys"
Jul 28 13:48:53.392408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392286    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b19614-dd11-478a-8da1-53099bec8de5" containerName="istio-proxy"
Jul 28 13:48:53.392408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392296    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a375373-7d92-49bd-a89d-e1250166d186" containerName="payload-pre-processing"
Jul 28 13:48:53.392408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392302    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="42f057d9-9ea7-41d9-879d-8c84255f4177" containerName="payload-processing"
Jul 28 13:48:53.392408 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.392307    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1c3111d-2256-4b41-84d9-f43bbb26bab7" containerName="payload-processing"
Jul 28 13:48:53.395380 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.395360    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.398220 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.398197    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4gt2h\"/\"default-dockercfg-tljvg\""
Jul 28 13:48:53.398648 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.398632    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gt2h\"/\"openshift-service-ca.crt\""
Jul 28 13:48:53.399262 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.399246    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gt2h\"/\"kube-root-ca.crt\""
Jul 28 13:48:53.412539 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.412507    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"]
Jul 28 13:48:53.496030 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.495995    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-lib-modules\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.496030 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.496032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-podres\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.496335 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.496054    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-proc\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.496335 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.496186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-httgx\" (UniqueName: \"kubernetes.io/projected/085226eb-82d6-456d-b6fb-89458f821375-kube-api-access-httgx\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.496335 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.496227    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-sys\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.597606 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.597565    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-httgx\" (UniqueName: \"kubernetes.io/projected/085226eb-82d6-456d-b6fb-89458f821375-kube-api-access-httgx\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.597606 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.597616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-sys\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.597908 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.597663    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-lib-modules\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.597908 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.597758    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-sys\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.597908 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.597772    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-lib-modules\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.597908 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.597804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-podres\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.597908 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.597848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-proc\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.597908 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.597936    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-podres\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.598191 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.597971    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/085226eb-82d6-456d-b6fb-89458f821375-proc\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.606494 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.606470    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-httgx\" (UniqueName: \"kubernetes.io/projected/085226eb-82d6-456d-b6fb-89458f821375-kube-api-access-httgx\") pod \"perf-node-gather-daemonset-w4j8n\" (UID: \"085226eb-82d6-456d-b6fb-89458f821375\") " pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.705031 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.704907    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:53.845695 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:53.845655    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"]
Jul 28 13:48:53.848733 ip-10-0-133-173 kubenswrapper[2567]: W0728 13:48:53.848701    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod085226eb_82d6_456d_b6fb_89458f821375.slice/crio-8cad6fb8ff96cc9c97c104c6477a274f13afa4c9b834b5f52fd33953eeeb7958 WatchSource:0}: Error finding container 8cad6fb8ff96cc9c97c104c6477a274f13afa4c9b834b5f52fd33953eeeb7958: Status 404 returned error can't find the container with id 8cad6fb8ff96cc9c97c104c6477a274f13afa4c9b834b5f52fd33953eeeb7958
Jul 28 13:48:54.766643 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:54.766606    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n" event={"ID":"085226eb-82d6-456d-b6fb-89458f821375","Type":"ContainerStarted","Data":"8c0f867e1e4905b25d1b18687de83d29d131f388d59dc5f60676d8e8e8f51401"}
Jul 28 13:48:54.767145 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:54.766667    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:48:54.767145 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:54.766686    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n" event={"ID":"085226eb-82d6-456d-b6fb-89458f821375","Type":"ContainerStarted","Data":"8cad6fb8ff96cc9c97c104c6477a274f13afa4c9b834b5f52fd33953eeeb7958"}
Jul 28 13:48:54.787138 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:54.787086    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n" podStartSLOduration=1.787068272 podStartE2EDuration="1.787068272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:48:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:48:54.785659082 +0000 UTC m=+3461.714943009" watchObservedRunningTime="2026-07-28 13:48:54.787068272 +0000 UTC m=+3461.716352206"
Jul 28 13:48:56.740696 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:56.740668    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-56thl_2900e2c5-02ba-4f9d-909a-85f7bc0dd0da/dns/0.log"
Jul 28 13:48:56.777216 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:56.777184    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-56thl_2900e2c5-02ba-4f9d-909a-85f7bc0dd0da/kube-rbac-proxy/0.log"
Jul 28 13:48:57.005036 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:57.004948    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v4cfk_2139ac10-b3ff-4ba1-8189-0d512d855d30/dns-node-resolver/0.log"
Jul 28 13:48:57.586546 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:57.586502    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6f8df94fc5-vk8pj_1198a39e-11df-4cc6-a295-46e9dbd3f85e/registry/0.log"
Jul 28 13:48:57.632949 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:57.632909    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9zk5p_e40068e5-fe90-4d0f-bedb-007c67c86f02/node-ca/0.log"
Jul 28 13:48:58.715522 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:58.715497    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p_338c18b9-7653-48cf-8e72-001f509376cf/istio-proxy/0.log"
Jul 28 13:48:58.896410 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:58.896377    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7897958f89-6zbsc_d364df40-37fc-4ecb-b7fa-a84fd7d3afa5/kube-auth-proxy/0.log"
Jul 28 13:48:58.962099 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:58.962065    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zk8s8_da01587a-958c-4fa8-858c-8baae2332d54/istio-proxy/0.log"
Jul 28 13:48:59.014365 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:59.014284    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zk8s8_da01587a-958c-4fa8-858c-8baae2332d54/istio-proxy/1.log"
Jul 28 13:48:59.059271 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:59.059239    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-rqvtg_97b468fc-bad3-458f-accb-86c8cfdcb950/payload-pre-processing/0.log"
Jul 28 13:48:59.992379 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:48:59.992294    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ng9ss_98a505de-a8f4-4d35-bcd3-968edd6d9ff5/serve-healthcheck-canary/0.log"
Jul 28 13:49:00.698473 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:00.698445    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ssjr7_6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896/kube-rbac-proxy/0.log"
Jul 28 13:49:00.741527 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:00.741499    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ssjr7_6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896/exporter/0.log"
Jul 28 13:49:00.781125 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:00.781091    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ssjr7_6a2270ea-0a8d-4ac0-8b3a-41cde5fa9896/extractor/0.log"
Jul 28 13:49:00.782577 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:00.782557    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4gt2h/perf-node-gather-daemonset-w4j8n"
Jul 28 13:49:03.146208 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:03.146181    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9zqxq_80b60f4e-b14d-4c03-a656-ba6a548e9242/manager/0.log"
Jul 28 13:49:03.538544 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:03.538499    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kjhqq_0b964906-db9c-46da-96c8-e0270325bbfa/manager/0.log"
Jul 28 13:49:03.630128 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:03.630093    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p_338c18b9-7653-48cf-8e72-001f509376cf/istio-proxy/0.log"
Jul 28 13:49:03.714965 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:03.714852    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cnl26_b03c1757-6a1e-4801-a1cb-4c5a0f38ecb1/server/0.log"
Jul 28 13:49:03.806398 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:03.806366    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7897958f89-6zbsc_d364df40-37fc-4ecb-b7fa-a84fd7d3afa5/kube-auth-proxy/0.log"
Jul 28 13:49:03.838289 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:03.838249    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bfrws_694cbac9-329f-438d-8b6b-37cc0bf513f9/manager/0.log"
Jul 28 13:49:03.851208 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:03.851169    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zk8s8_da01587a-958c-4fa8-858c-8baae2332d54/istio-proxy/0.log"
Jul 28 13:49:03.904589 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:03.904553    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zk8s8_da01587a-958c-4fa8-858c-8baae2332d54/istio-proxy/1.log"
Jul 28 13:49:03.938169 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:03.938126    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-rqvtg_97b468fc-bad3-458f-accb-86c8cfdcb950/payload-pre-processing/0.log"
Jul 28 13:49:04.097621 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:04.097586    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bb544cf8-qnv86_9c3687a8-4991-4a6c-a90c-c026c4ee93b9/manager/0.log"
Jul 28 13:49:04.121603 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:04.121576    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64bb544cf8-qnv86_9c3687a8-4991-4a6c-a90c-c026c4ee93b9/copy-manifests/0.log"
Jul 28 13:49:05.491841 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:05.491805    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-h656p_338c18b9-7653-48cf-8e72-001f509376cf/istio-proxy/0.log"
Jul 28 13:49:05.547596 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:05.547570    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-w95p6_b2597afe-0b52-4b32-8840-d382b1b52b90/openshift-lws-operator/0.log"
Jul 28 13:49:05.682659 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:05.682630    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7897958f89-6zbsc_d364df40-37fc-4ecb-b7fa-a84fd7d3afa5/kube-auth-proxy/0.log"
Jul 28 13:49:05.723839 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:05.723789    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zk8s8_da01587a-958c-4fa8-858c-8baae2332d54/istio-proxy/0.log"
Jul 28 13:49:05.778748 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:05.778714    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zk8s8_da01587a-958c-4fa8-858c-8baae2332d54/istio-proxy/1.log"
Jul 28 13:49:05.812605 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:05.812570    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-rqvtg_97b468fc-bad3-458f-accb-86c8cfdcb950/payload-pre-processing/0.log"
Jul 28 13:49:10.752818 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:10.752730    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bkxwz_b3d76279-c0b1-46d6-b8b5-3011de9ef2e4/migrator/0.log"
Jul 28 13:49:10.781768 ip-10-0-133-173 kubenswrapper[2567]: I0728 13:49:10.781744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-bkxwz_b3d76279-c0b1-46d6-b8b5-3011de9ef2e4/graceful-termination/0.log"