Jul 28 01:02:13.044041 ip-10-0-137-121 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 01:02:13.044056 ip-10-0-137-121 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 01:02:13.044065 ip-10-0-137-121 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 01:02:13.044391 ip-10-0-137-121 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 01:02:23.068375 ip-10-0-137-121 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 01:02:23.068394 ip-10-0-137-121 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d501d774f2f94af1a09ca4504a88c95b --
Jul 28 01:04:26.023189 ip-10-0-137-121 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 01:04:26.460631 ip-10-0-137-121 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:04:26.460631 ip-10-0-137-121 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 01:04:26.460631 ip-10-0-137-121 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:04:26.460631 ip-10-0-137-121 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 01:04:26.460631 ip-10-0-137-121 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 01:04:26.461859 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.461699    2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 01:04:26.468368 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468348    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:04:26.468368 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468365    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:04:26.468368 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468369    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:04:26.468368 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468372    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468376    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468379    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468382    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468385    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468388    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468391    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468394    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468396    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468399    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468402    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468405    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468407    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468410    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468413    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468415    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468418    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468421    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468423    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468426    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:04:26.468488 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468434    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468437    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468439    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468442    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468445    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468447    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468449    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468452    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468454    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468457    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468459    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468462    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468465    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468467    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468471    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468473    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468476    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468478    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468481    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468483    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:04:26.468982 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468486    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468488    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468492    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468495    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468497    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468500    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468503    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468507    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468511    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468514    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468516    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468519    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468522    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468525    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468527    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468529    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468532    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468534    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468537    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:04:26.469472 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468539    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468541    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468544    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468546    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468548    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468551    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468554    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468557    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468559    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468562    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468565    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468568    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468570    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468574    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468577    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468581    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468583    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468586    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468611    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468615    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:04:26.469954 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468618    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468621    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468624    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468627    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468629    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468632    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468635    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468638    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468641    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468643    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468647    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468650    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468653    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468656    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468659    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468662    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.468664    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470277    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470284    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:04:26.470433 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470288    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470291    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470294    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470298    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470301    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470303    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470306    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470308    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470311    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470314    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470317    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470320    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470322    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470325    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470327    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470330    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470332    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470335    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470337    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470339    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:04:26.470893 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470342    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470345    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470347    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470351    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470355    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470360    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470364    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470367    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470370    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470373    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470376    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470379    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470381    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470384    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470386    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470389    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470392    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470394    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470397    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:04:26.471443 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470399    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470402    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470404    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470407    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470409    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470411    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470414    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470416    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470419    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470421    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470423    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470426    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470428    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470431    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470433    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470436    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470438    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470441    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470443    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:04:26.471923 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470446    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470449    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470451    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470454    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470457    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470460    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470462    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470465    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470467    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470470    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470472    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470475    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470477    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470480    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470483    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470486    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470488    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470490    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470493    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470495    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:04:26.472389 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470498    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470500    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470502    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470505    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470507    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470509    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470512    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470514    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470516    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470519    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470521    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470523    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470526    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470529    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470531    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470534    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470536    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470539    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470541    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470929    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:04:26.472882 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470934    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470936    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470940    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470943    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470946    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470949    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470952    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470954    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470957    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470959    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470962    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470964    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470967    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470970    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470972    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470975    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470977    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470980    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470982    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470985    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:04:26.473379 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470988    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470991    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470993    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.470996    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471002    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471004    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471007    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471011    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471015    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471018    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471020    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471023    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471025    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471028    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471030    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471033    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471036    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471038    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471042    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:04:26.473867 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471045    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471048    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471051    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471054    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471056    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471059    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471061    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471063    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471066    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471068    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471070    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471074    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471076    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471079    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471081    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471083    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471086    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471089    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471092    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471094    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:04:26.474335 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471097    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471099    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471102    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471104    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471107    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471109    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471112    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471114    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471116    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471119    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471122    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471124    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471127    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471129    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471132    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471134    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471136    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471139    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471141    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:04:26.474818 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471144    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471146    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471148    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471151    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471153    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471156    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471158    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471160    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471163    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471165    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471169    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471172    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471175    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471178    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471180    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471183    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471185    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471188    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471190    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471192    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:04:26.475314 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471263    2552 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471270    2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471276    2552 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471280    2552 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471285    2552 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471289    2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471294    2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471298    2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471302    2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471304    2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471308    2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471311    2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471314    2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471317    2552 flags.go:64] FLAG: --cgroup-root=""
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471320    2552 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471323    2552 flags.go:64] FLAG: --client-ca-file=""
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471326    2552 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471329    2552 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471340    2552 flags.go:64] FLAG: --cluster-domain=""
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471342    2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471345    2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471348    2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471353    2552 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471356    2552 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 01:04:26.475846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471359    2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471362    2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471367    2552 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471370    2552 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471373    2552 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471376    2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471379    2552 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471382    2552 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471386    2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471389    2552 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471391    2552 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471394    2552 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471397    2552 flags.go:64] FLAG: --enable-server="true"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471400    2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471405    2552 flags.go:64] FLAG: --event-burst="100"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471408    2552 flags.go:64] FLAG: --event-qps="50"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471410    2552 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471413    2552 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471416    2552 flags.go:64] FLAG: --eviction-hard=""
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471419    2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471422    2552 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471425    2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471428    2552 flags.go:64] FLAG: --eviction-soft=""
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471431    2552 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471433    2552 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 01:04:26.476488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471436    2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471439    2552 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471442    2552 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471444    2552 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471447    2552 flags.go:64] FLAG: --feature-gates=""
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471452    2552 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471455    2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471459    2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471462    2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471465    2552 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471468    2552 flags.go:64] FLAG: --help="false"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471471    2552 flags.go:64] FLAG: --hostname-override="ip-10-0-137-121.ec2.internal"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471474    2552 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471477    2552 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471480    2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471483    2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471486    2552 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471489    2552 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471492    2552 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471494    2552 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471497    2552 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471500    2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471503    2552 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471506    2552 flags.go:64] FLAG: --kube-reserved=""
Jul 28 01:04:26.477124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471509    2552 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471512    2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471515    2552 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471517    2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471520    2552 flags.go:64] FLAG: --lock-file=""
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471522    2552 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471525    2552 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471528    2552 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471533    2552 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471536    2552 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471539    2552 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471541    2552 flags.go:64] FLAG: --logging-format="text"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471544    2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471547    2552 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471550    2552 flags.go:64] FLAG: --manifest-url=""
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471553    2552 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471557    2552 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471560    2552 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471564    2552 flags.go:64] FLAG: --max-pods="110"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471567    2552 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471570    2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471573    2552 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471577    2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471579    2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471582    2552 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 01:04:26.477736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471585    2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471592    2552 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471595    2552 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471598    2552 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471600    2552 flags.go:64] FLAG: --pod-cidr=""
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471604    2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471609    2552 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471613    2552 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471616    2552 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471619    2552 flags.go:64] FLAG: --port="10250"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471621    2552 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471624    2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08b8b8134919937b3"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471627    2552 flags.go:64] FLAG: --qos-reserved=""
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471630    2552 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471632    2552 flags.go:64] FLAG: --register-node="true"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471635    2552 flags.go:64] FLAG: --register-with-taints=""
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471639    2552 flags.go:64] FLAG: --registry-burst="10"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471641    2552 flags.go:64] FLAG: --registry-qps="5"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471644    2552 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471647    2552 flags.go:64] FLAG: --reserved-memory=""
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471650    2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471653    2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471656    2552 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471659    2552 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471662    2552 flags.go:64] FLAG: --runonce="false"
Jul 28 01:04:26.478368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471665    2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471668    2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471671    2552 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471674    2552 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471676    2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471679    2552 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471682    2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471685    2552 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471687    2552 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471690    2552 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471693    2552 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471695    2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471698    2552 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471703    2552 flags.go:64] FLAG: --system-cgroups=""
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471705    2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471710    2552 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471713    2552 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471716    2552 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471719    2552 flags.go:64] FLAG: --tls-min-version=""
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471722    2552 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471725    2552 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471727    2552 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471730    2552 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471733    2552 flags.go:64] FLAG: --v="2"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471737    2552 flags.go:64] FLAG: --version="false"
Jul 28 01:04:26.478986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471741    2552 flags.go:64] FLAG: --vmodule=""
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471744    2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.471747    2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471861    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471864    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471867    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471870    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471872    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471875    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471878    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471880    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471882    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471885    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471887    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471890    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471892    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471894    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471897    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471899    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471917    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:04:26.479613 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471920    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471926    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471929    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471932    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471934    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471937    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471939    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471942    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471944    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471948    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471951    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471954    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471956    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471959    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471962    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471964    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471968    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471970    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471974    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471978    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:04:26.480110 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471981    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471983    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471986    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471988    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471991    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471993    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471996    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.471999    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472001    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472004    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472006    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472009    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472012    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472014    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472017    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472019    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472022    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472024    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472027    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472029    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:04:26.480592 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472031    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472035    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472039    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472043    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472046    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472049    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472052    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472055    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472059    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472061    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472064    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472067    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472069    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472072    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472075    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472077    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472080    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472083    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472086    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:04:26.481091 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472089    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472092    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472095    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472097    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472100    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472102    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472104    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472107    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472110    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472113    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472115    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472118    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472120    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472123    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472126    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472129    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472131    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472134    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472136    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472139    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:04:26.481556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472141    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472145    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.472147    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.472156    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.478924    2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.478940    2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.478958    2552 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.478965    2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479025    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479030    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479034    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479037    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479039    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479042    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479044    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:04:26.482066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479047    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479050    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479053    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479055    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479059    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479063    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479066    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479069    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479072    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479075    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479078    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479081    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479084    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479086    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479090    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479094    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479096    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479099    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479101    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:04:26.482450 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479105    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479107    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479109    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479114    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479117    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479119    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479122    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479125    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479127    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479130    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479132    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479135    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479137    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479140    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479142    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479144    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479147    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479150    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479152    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479154    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:04:26.483057 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479157    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479160    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479162    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479165    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479167    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479169    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479172    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479174    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479177    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479179    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479182    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479184    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479187    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479189    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479191    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479194    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479197    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479200    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479203    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479205    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:04:26.483546 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479208    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479210    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479213    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479215    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479218    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479220    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479222    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479225    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479227    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479230    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479232    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479234    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479237    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479239    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479241    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479244    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479246    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479248    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479251    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:04:26.484047 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479253    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479255    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479258    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479260    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479262    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479265    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479267    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479270    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479273    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479276    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479279    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479282    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479284    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479287    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.479291    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:04:26.484485 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479405    2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479410    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479413    2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479416    2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479419    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479422    2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479424    2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479427    2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479430    2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479433    2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479435    2552 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479438    2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479441    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479443    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479446    2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479449    2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479452    2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479455    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479458    2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479460    2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 01:04:26.484858 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479463    2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479465    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479468    2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479470    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479472    2552 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479475    2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479478    2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479480    2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479484    2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479488    2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479491    2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479493    2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479496    2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479498    2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479500    2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479503    2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479505    2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479508    2552 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479510    2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479513    2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 01:04:26.485349 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479515    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479518    2552 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479520    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479522    2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479525    2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479527    2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479530    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479533    2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479535    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479538    2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479541    2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479543    2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479545    2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479548    2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479550    2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479553    2552 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479555    2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479558    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479561    2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479563    2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 01:04:26.485834 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479566    2552 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479568    2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479571    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479573    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479575    2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479578    2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479580    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479583    2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479585    2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479588    2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479590    2552 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479592    2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479595    2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479597    2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479599    2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479602    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479604    2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479606    2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479609    2552 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 01:04:26.486322 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479611    2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479615    2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479619    2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479622    2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479625    2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479628    2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479632    2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479635    2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479637    2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479639    2552 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479642    2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479644    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479647    2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479649    2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479651    2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479654    2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479657    2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479659    2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479661    2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 01:04:26.486771 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:26.479664    2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 01:04:26.487260 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.479669    2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 01:04:26.487260 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.479771    2552 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 01:04:26.487260 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.481946    2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 01:04:26.487260 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.483743    2552 server.go:1019] "Starting client certificate rotation"
Jul 28 01:04:26.487260 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.483841    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 01:04:26.487260 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.483881    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 01:04:26.487260 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.486729    2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 01:04:26.493659 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.493636    2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 01:04:26.504930 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.504896    2552 log.go:25] "Validated CRI v1 runtime API"
Jul 28 01:04:26.506966 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.506953    2552 log.go:25] "Validated CRI v1 image API"
Jul 28 01:04:26.507697 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.507683    2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 01:04:26.510810 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.510784    2552 fs.go:135] Filesystem UUIDs: map[0d6b1f57-a4d6-495c-9662-085e24e40e07:/dev/nvme0n1p4 341e4084-0c42-44bb-89be-f289e3b7aee4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 28 01:04:26.510872 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.510809    2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 01:04:26.513286 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.513269    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 01:04:26.516032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.515927    2552 manager.go:216] Machine: {Timestamp:2026-07-28 01:04:26.514549762 +0000 UTC m=+0.368083327 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3071887 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26884caabe10075fa3c801bf8eaa95 SystemUUID:ec26884c-aabe-1007-5fa3-c801bf8eaa95 BootID:d501d774-f2f9-4af1-a09c-a4504a88c95b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6c:1f:8b:a6:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6c:1f:8b:a6:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:04:40:09:e8:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 01:04:26.516032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.516026    2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 01:04:26.516141 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.516101    2552 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 01:04:26.519158 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.519130    2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 01:04:26.519290 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.519161    2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 01:04:26.520714 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.520703    2552 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 01:04:26.520758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.520717    2552 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 01:04:26.520758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.520730    2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 01:04:26.521842 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.521828    2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 01:04:26.523302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.523291    2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 01:04:26.526518 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.526506    2552 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 01:04:26.526634 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.526624    2552 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 01:04:26.526674 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.526653    2552 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 01:04:26.526674 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.526670    2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 01:04:26.526745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.526685    2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 01:04:26.526745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.526694    2552 kubelet.go:398] "Adding apiserver pod source"
Jul 28 01:04:26.526745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.526703    2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 01:04:26.527111 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.527098    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 01:04:26.527163 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.527120    2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 01:04:26.529437 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.529422    2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 01:04:26.530409 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.530389    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-blwth"
Jul 28 01:04:26.531191 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.531179    2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 01:04:26.531223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.531209    2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 01:04:26.532002 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.531985    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 01:04:26.532061 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532015    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 01:04:26.532061 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532028    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 01:04:26.532061 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532041    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 01:04:26.532140 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532074    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 01:04:26.532140 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532087    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 01:04:26.532140 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532101    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 01:04:26.532140 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532113    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 01:04:26.532140 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532126    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 01:04:26.532140 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532137    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 01:04:26.532290 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532168    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 01:04:26.532290 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.532180    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 01:04:26.533183 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.533170    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 01:04:26.533225 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.533184    2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 01:04:26.536452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.536436    2552 server.go:1268] "Started kubelet"
Jul 28 01:04:26.536544 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.536494    2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 01:04:26.537262 ip-10-0-137-121 systemd[1]: Started Kubernetes Kubelet.
Jul 28 01:04:26.539970 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.539893    2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 01:04:26.540049 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.539996    2552 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 01:04:26.540741 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.540723    2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 01:04:26.541011 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.540987    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 01:04:26.541101 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.541081    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-blwth"
Jul 28 01:04:26.541329 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.541308    2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 01:04:26.542043 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.542024    2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 01:04:26.542175 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.542155    2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 01:04:26.543533 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.543517    2552 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 01:04:26.546967 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.545933    2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-121.ec2.internal.18c64e8c3db17cc2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-121.ec2.internal,UID:ip-10-0-137-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-121.ec2.internal,},FirstTimestamp:2026-07-28 01:04:26.536410306 +0000 UTC m=+0.389943869,LastTimestamp:2026-07-28 01:04:26.536410306 +0000 UTC m=+0.389943869,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-121.ec2.internal,}"
Jul 28 01:04:26.550088 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.550071    2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 01:04:26.550183 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.550076    2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 01:04:26.550240 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.550210    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:26.550782 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.550767    2552 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 01:04:26.550782 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.550783    2552 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 01:04:26.550922 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.550895    2552 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 01:04:26.550922 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.550921    2552 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 01:04:26.551013 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.550950    2552 factory.go:55] Registering systemd factory
Jul 28 01:04:26.551013 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.550991    2552 factory.go:223] Registration of the systemd container factory successfully
Jul 28 01:04:26.551169 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.551090    2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 01:04:26.551360 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.551343    2552 factory.go:153] Registering CRI-O factory
Jul 28 01:04:26.551360 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.551362    2552 factory.go:223] Registration of the crio container factory successfully
Jul 28 01:04:26.551481 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.551414    2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 01:04:26.551481 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.551438    2552 factory.go:103] Registering Raw factory
Jul 28 01:04:26.551481 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.551451    2552 manager.go:1196] Started watching for new ooms in manager
Jul 28 01:04:26.552071 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.552053    2552 manager.go:349] Starting recovery of all containers
Jul 28 01:04:26.552708 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.552686    2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:04:26.555535 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.555501    2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-121.ec2.internal\" not found" node="ip-10-0-137-121.ec2.internal"
Jul 28 01:04:26.562199 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.562018    2552 manager.go:354] Recovery completed
Jul 28 01:04:26.566804 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.566787    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:04:26.569062 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.569042    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:04:26.569142 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.569081    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:04:26.569142 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.569093    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:04:26.569640 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.569627    2552 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 01:04:26.569640 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.569638    2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 01:04:26.569640 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.569641    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:04:26.569829 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.569656    2552 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 01:04:26.570618 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.570600    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:04:26.570697 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.570634    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:04:26.570697 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.570649    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:04:26.571155 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.571142    2552 policy_none.go:49] "None policy: Start"
Jul 28 01:04:26.571188 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.571159    2552 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 01:04:26.571188 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.571170    2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 01:04:26.572337 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.572326    2552 policy_none.go:47] "Start"
Jul 28 01:04:26.615583 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.615564    2552 manager.go:337] "Starting Device Plugin manager"
Jul 28 01:04:26.615707 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.615603    2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 01:04:26.615707 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.615613    2552 server.go:87] "Starting device plugin registration server"
Jul 28 01:04:26.615934 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.615920    2552 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 01:04:26.616016 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.615938    2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 01:04:26.616158 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.616121    2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 01:04:26.616267 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.616215    2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 01:04:26.616267 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.616223    2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 01:04:26.616718 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.616702    2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 01:04:26.616792 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.616746    2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:26.716129 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.716068    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:04:26.717608 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.717593    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:04:26.717684 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.717625    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:04:26.717684 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.717639    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:04:26.717684 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.717668    2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-121.ec2.internal"
Jul 28 01:04:26.723433 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.723415    2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-121.ec2.internal"
Jul 28 01:04:26.723510 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.723437    2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-121.ec2.internal\": node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:26.734773 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.734751    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:26.774627 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.774590    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 01:04:26.775961 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.775946    2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 01:04:26.776050 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.775987    2552 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 01:04:26.776050 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.776018    2552 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 01:04:26.776141 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.776056    2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 01:04:26.778423 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.778400    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:04:26.835507 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.835477    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:26.876980 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.876945    2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"]
Jul 28 01:04:26.877117 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.877026    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:04:26.879421 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.879401    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:04:26.879510 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.879441    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:04:26.879510 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.879456    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:04:26.880807 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.880792    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:04:26.880971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.880956    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:26.881028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.880991    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:04:26.881981 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.881967    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:04:26.882056 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.881991    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:04:26.882056 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.882003    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:04:26.882056 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.882024    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:04:26.882056 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.882033    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:04:26.882056 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.882006    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:04:26.883459 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.883446    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:26.883543 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.883471    2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 01:04:26.884243 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.884229    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 01:04:26.884311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.884260    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 01:04:26.884311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.884275    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Jul 28 01:04:26.900493 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.900470    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-121.ec2.internal\" not found" node="ip-10-0-137-121.ec2.internal"
Jul 28 01:04:26.904506 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.904491    2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-121.ec2.internal\" not found" node="ip-10-0-137-121.ec2.internal"
Jul 28 01:04:26.936221 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:26.936195    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:26.952899 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.952872    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:26.952899 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.952898    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:26.953083 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:26.952933    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5335f321bbdc98b925d1a74da4b1481d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-121.ec2.internal\" (UID: \"5335f321bbdc98b925d1a74da4b1481d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:27.037149 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:27.037067    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:27.053467 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:27.053435    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:27.053594 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:27.053387    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:27.053594 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:27.053516    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:27.053594 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:27.053551    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5335f321bbdc98b925d1a74da4b1481d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-121.ec2.internal\" (UID: \"5335f321bbdc98b925d1a74da4b1481d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:27.053714 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:27.053607    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5335f321bbdc98b925d1a74da4b1481d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-121.ec2.internal\" (UID: \"5335f321bbdc98b925d1a74da4b1481d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:27.053714 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:27.053637    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:27.137595 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:27.137550    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:28.443386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:28.443351    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:28.448701 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:28.448523    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:28.477720 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:28.477682    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:28.578368 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:28.578285    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:28.678809 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:28.678764    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:28.722311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:28.722283    2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 01:04:28.722809 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:28.722419    2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 01:04:28.722809 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:28.722426    2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 01:04:28.779759 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:28.779713    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:28.786435 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:28.786393    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 00:59:27 +0000 UTC" deadline="2028-04-08 23:35:20.580210348 +0000 UTC"
Jul 28 01:04:28.786435 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:28.786432    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14902h30m51.793782642s"
Jul 28 01:04:28.880648 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:28.880621    2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Jul 28 01:04:28.970486 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:28.970461    2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:04:28.971794 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:28.971767    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5335f321bbdc98b925d1a74da4b1481d.slice/crio-85138104c53e75188948edf4099c4c0dabf3d46e7eed0dd0a120c77ac669f7d1 WatchSource:0}: Error finding container 85138104c53e75188948edf4099c4c0dabf3d46e7eed0dd0a120c77ac669f7d1: Status 404 returned error can't find the container with id 85138104c53e75188948edf4099c4c0dabf3d46e7eed0dd0a120c77ac669f7d1
Jul 28 01:04:28.972209 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:28.972193    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b2f14a2e561079373fe06316702acf.slice/crio-a717368d8b7a118bcc1235c404a994ca4153a5171fe86ba8146d7782b0b1d73c WatchSource:0}: Error finding container a717368d8b7a118bcc1235c404a994ca4153a5171fe86ba8146d7782b0b1d73c: Status 404 returned error can't find the container with id a717368d8b7a118bcc1235c404a994ca4153a5171fe86ba8146d7782b0b1d73c
Jul 28 01:04:28.977738 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:28.977723    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:04:28.990372 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:28.990338    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:29.000392 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.000374    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 01:04:29.002570 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.002553    2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Jul 28 01:04:29.009851 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.009835    2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 01:04:29.019090 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.019047    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" event={"ID":"98b2f14a2e561079373fe06316702acf","Type":"ContainerStarted","Data":"a717368d8b7a118bcc1235c404a994ca4153a5171fe86ba8146d7782b0b1d73c"}
Jul 28 01:04:29.020057 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.020038    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" event={"ID":"5335f321bbdc98b925d1a74da4b1481d","Type":"ContainerStarted","Data":"85138104c53e75188948edf4099c4c0dabf3d46e7eed0dd0a120c77ac669f7d1"}
Jul 28 01:04:29.374143 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.374103    2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:04:29.555482 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.555445    2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:04:29.766882 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.766801    2552 apiserver.go:52] "Watching apiserver"
Jul 28 01:04:29.772849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.772821    2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 01:04:29.773660 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.773282    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-fsnhz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal","openshift-multus/multus-additional-cni-plugins-8blwn","openshift-multus/multus-sb7r5","kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal","openshift-cluster-node-tuning-operator/tuned-smkjs","openshift-multus/network-metrics-daemon-wj5vw","openshift-network-diagnostics/network-check-target-vhzqm","openshift-network-operator/iptables-alerter-r5fkk","openshift-ovn-kubernetes/ovnkube-node-k2999","kube-system/global-pull-secret-syncer-vlsb4","kube-system/konnectivity-agent-5shbb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p","openshift-dns/node-resolver-jr95w"]
Jul 28 01:04:29.775205 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.775184    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:29.776572 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.776549    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:29.776705 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.776629    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:29.777845 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.777452    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lnhhg\""
Jul 28 01:04:29.777845 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.777623    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 01:04:29.777845 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.777702    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 01:04:29.777845 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.777795    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 01:04:29.779417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.779396    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.781144 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.781106    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.781359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.781329    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 01:04:29.781670 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.781650    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 01:04:29.781793 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.781657    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8fmqh\""
Jul 28 01:04:29.781793 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.781693    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 01:04:29.782151 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.782116    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 01:04:29.782459 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.782295    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 01:04:29.783266 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.783236    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 01:04:29.783362 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.783332    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:29.783467 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.783448    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:29.783740 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.783721    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vwvpj\""
Jul 28 01:04:29.784782 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.784766    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.786144 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.786112    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:29.786994 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.786804    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:04:29.786994 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.786854    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9qwtx\""
Jul 28 01:04:29.786994 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.786960    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 01:04:29.787695 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.787677    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.788390 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.788371    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8grww\""
Jul 28 01:04:29.788499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.788428    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 01:04:29.788499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.788437    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 01:04:29.788754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.788734    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 01:04:29.789655 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.789636    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 01:04:29.789852 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.789839    2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 01:04:29.790295 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.790276    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:29.790379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.790321    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 01:04:29.790379 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.790344    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:29.791089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.790599    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x4597\""
Jul 28 01:04:29.791089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.790602    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 01:04:29.791089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.790880    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 01:04:29.791089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.791003    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 01:04:29.791089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.791015    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:29.795347 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.795326    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 01:04:29.795593 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.795577    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f9d7t\""
Jul 28 01:04:29.795794 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.795777    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 01:04:29.797373 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.797347    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:29.797683 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.797666    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.799905 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.799878    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 01:04:29.801170 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.800943    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 01:04:29.801170 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.801030    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 01:04:29.801170 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.801148    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zhhkc\""
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.801332    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.801349    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v9ckx\""
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.801517    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.801563    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.801852    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-run-openvswitch\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.801887    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-log-socket\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.801953    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.801987    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed1210a9-c2dc-4164-8fd8-0bf75730917c-ovnkube-config\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802039    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5036ccb-ced6-4454-8216-7a43d1f73774-konnectivity-ca\") pod \"konnectivity-agent-5shbb\" (UID: \"f5036ccb-ced6-4454-8216-7a43d1f73774\") " pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802072    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kchwp\" (UniqueName: \"kubernetes.io/projected/b78c0dba-b7d9-4361-95f2-c0990578e1e6-kube-api-access-kchwp\") pod \"node-ca-fsnhz\" (UID: \"b78c0dba-b7d9-4361-95f2-c0990578e1e6\") " pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:29.802165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802108    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-sysctl-conf\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.802744 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802170    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-conf-dir\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.802744 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802251    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed1210a9-c2dc-4164-8fd8-0bf75730917c-env-overrides\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.802836 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802300    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b78c0dba-b7d9-4361-95f2-c0990578e1e6-host\") pod \"node-ca-fsnhz\" (UID: \"b78c0dba-b7d9-4361-95f2-c0990578e1e6\") " pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:29.802836 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802805    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-os-release\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.802910 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802836    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.802910 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802861    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-system-cni-dir\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.802910 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802886    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fs55\" (UniqueName: \"kubernetes.io/projected/cb57a35c-1920-4e4d-a1d2-267511f02cbd-kube-api-access-2fs55\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.803017 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802910    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62jzt\" (UniqueName: \"kubernetes.io/projected/b55dc23e-8f3c-41ba-9d22-d3bd76112806-kube-api-access-62jzt\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:29.803017 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802933    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-run-systemd\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.803017 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802956    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw55b\" (UniqueName: \"kubernetes.io/projected/ed1210a9-c2dc-4164-8fd8-0bf75730917c-kube-api-access-jw55b\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.803017 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.802986    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5036ccb-ced6-4454-8216-7a43d1f73774-agent-certs\") pod \"konnectivity-agent-5shbb\" (UID: \"f5036ccb-ced6-4454-8216-7a43d1f73774\") " pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:29.803017 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803010    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-cnibin\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.803187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803033    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46d16632-292e-409c-a90d-931eb85e6e88-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.803187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803081    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-cni-dir\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.803187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803104    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-os-release\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.803187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803149    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-var-lib-cni-multus\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.803187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803174    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-kubelet-config\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:29.803340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803197    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-sys-fs\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.803340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803219    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-modprobe-d\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.803340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803240    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-host\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.803340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803263    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-slash\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.803340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803285    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-system-cni-dir\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.803340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803309    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46d16632-292e-409c-a90d-931eb85e6e88-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.803516 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803340    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-sysconfig\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.803516 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803363    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-kubernetes\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.803516 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803383    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-run\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.803516 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803403    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-lib-modules\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.803516 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803440    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-var-lib-kubelet\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.803516 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803463    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-run-netns\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.803516 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803485    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-run-ovn\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.803516 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803506    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-node-log\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.803754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803530    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.803754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803548    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-run-netns\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.803754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803621    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-run-multus-certs\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.803754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803671    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c37c5a75-2bfd-4e08-ae2d-8793eb0b6555-iptables-alerter-script\") pod \"iptables-alerter-r5fkk\" (UID: \"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555\") " pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:29.803754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803694    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-etc-kubernetes\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.803754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803723    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.803971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803767    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:29.803971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803789    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-systemd\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.803971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803838    2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 01:04:29.803971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803832    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b78c0dba-b7d9-4361-95f2-c0990578e1e6-serviceca\") pod \"node-ca-fsnhz\" (UID: \"b78c0dba-b7d9-4361-95f2-c0990578e1e6\") " pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:29.803971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803877    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-tuned\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.803971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803905    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c37c5a75-2bfd-4e08-ae2d-8793eb0b6555-host-slash\") pod \"iptables-alerter-r5fkk\" (UID: \"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555\") " pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:29.803971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.803939    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-daemon-config\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.804277 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804054    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-etc-openvswitch\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.804277 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804093    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-cni-bin\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.804277 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804147    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7485b6d6-5852-4818-a6aa-e85e9a6189a9-cni-binary-copy\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.804277 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804199    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-registration-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.804277 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804238    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-kubelet\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.804277 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804265    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-var-lib-openvswitch\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.804554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804303    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:29.804554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-systemd-units\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.804554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804352    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46d16632-292e-409c-a90d-931eb85e6e88-cni-binary-copy\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.804554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804386    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-sys\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.804554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804439    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-var-lib-kubelet\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.804554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804470    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qhnk\" (UniqueName: \"kubernetes.io/projected/7485b6d6-5852-4818-a6aa-e85e9a6189a9-kube-api-access-5qhnk\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.804554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804507    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-cni-netd\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.804554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804546    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed1210a9-c2dc-4164-8fd8-0bf75730917c-ovn-node-metrics-cert\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804577    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2dgh\" (UniqueName: \"kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh\") pod \"network-check-target-vhzqm\" (UID: \"648080a2-3ab7-4a37-9369-4ee8309eb43d\") " pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804601    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-var-lib-cni-bin\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804651    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-sysctl-d\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804677    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-socket-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804707    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-device-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804738    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed1210a9-c2dc-4164-8fd8-0bf75730917c-ovnkube-script-lib\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804824    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm4d7\" (UniqueName: \"kubernetes.io/projected/46d16632-292e-409c-a90d-931eb85e6e88-kube-api-access-tm4d7\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804851    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca0e813e-f648-4852-b34e-6e7e90b68421-tmp\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804896    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-run-k8s-cni-cncf-io\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804921    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-hostroot\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.804967    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-cnibin\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.805001    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-socket-dir-parent\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.805043    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-dbus\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:29.805075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.805075    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.805704 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.805104    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk8t2\" (UniqueName: \"kubernetes.io/projected/ca0e813e-f648-4852-b34e-6e7e90b68421-kube-api-access-sk8t2\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.823077 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.823054    2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5r889"
Jul 28 01:04:29.831838 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.830106    2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5r889"
Jul 28 01:04:29.842278 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.842256    2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 01:04:29.891334 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.891304    2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 01:04:29.905373 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905340    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.905559 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905390    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed1210a9-c2dc-4164-8fd8-0bf75730917c-ovnkube-config\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.905559 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905416    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5036ccb-ced6-4454-8216-7a43d1f73774-konnectivity-ca\") pod \"konnectivity-agent-5shbb\" (UID: \"f5036ccb-ced6-4454-8216-7a43d1f73774\") " pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:29.905559 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905448    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.905727 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905581    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kchwp\" (UniqueName: \"kubernetes.io/projected/b78c0dba-b7d9-4361-95f2-c0990578e1e6-kube-api-access-kchwp\") pod \"node-ca-fsnhz\" (UID: \"b78c0dba-b7d9-4361-95f2-c0990578e1e6\") " pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:29.905727 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905618    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-sysctl-conf\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.905727 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905645    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-conf-dir\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.905727 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905667    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed1210a9-c2dc-4164-8fd8-0bf75730917c-env-overrides\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.905727 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905689    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b78c0dba-b7d9-4361-95f2-c0990578e1e6-host\") pod \"node-ca-fsnhz\" (UID: \"b78c0dba-b7d9-4361-95f2-c0990578e1e6\") " pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:29.905727 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905711    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-os-release\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.905995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905737    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.905995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905760    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-system-cni-dir\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.905995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905784    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fs55\" (UniqueName: \"kubernetes.io/projected/cb57a35c-1920-4e4d-a1d2-267511f02cbd-kube-api-access-2fs55\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.905995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905807    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62jzt\" (UniqueName: \"kubernetes.io/projected/b55dc23e-8f3c-41ba-9d22-d3bd76112806-kube-api-access-62jzt\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:29.905995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905858    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-run-systemd\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.905995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905884    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw55b\" (UniqueName: \"kubernetes.io/projected/ed1210a9-c2dc-4164-8fd8-0bf75730917c-kube-api-access-jw55b\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.905995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905911    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5036ccb-ced6-4454-8216-7a43d1f73774-agent-certs\") pod \"konnectivity-agent-5shbb\" (UID: \"f5036ccb-ced6-4454-8216-7a43d1f73774\") " pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:29.905995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905935    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-cnibin\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.905995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905958    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46d16632-292e-409c-a90d-931eb85e6e88-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.905995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.905982    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-cni-dir\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906005    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-os-release\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906028    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-var-lib-cni-multus\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906049    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5036ccb-ced6-4454-8216-7a43d1f73774-konnectivity-ca\") pod \"konnectivity-agent-5shbb\" (UID: \"f5036ccb-ced6-4454-8216-7a43d1f73774\") " pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906072    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed1210a9-c2dc-4164-8fd8-0bf75730917c-ovnkube-config\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906053    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-kubelet-config\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906122    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-kubelet-config\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906245    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-sys-fs\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906274    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-modprobe-d\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906299    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-host\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906323    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-run-systemd\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906329    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crnlz\" (UniqueName: \"kubernetes.io/projected/c37c5a75-2bfd-4e08-ae2d-8793eb0b6555-kube-api-access-crnlz\") pod \"iptables-alerter-r5fkk\" (UID: \"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555\") " pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906357    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-slash\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.906394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906395    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-system-cni-dir\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906413    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46d16632-292e-409c-a90d-931eb85e6e88-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906431    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-sysconfig\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906445    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-kubernetes\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906459    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-run\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906482    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-lib-modules\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906505    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-var-lib-kubelet\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906534    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-run-netns\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906557    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-run-ovn\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906579    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-node-log\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906600    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906615    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-run-netns\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906637    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-run-multus-certs\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906654    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c37c5a75-2bfd-4e08-ae2d-8793eb0b6555-iptables-alerter-script\") pod \"iptables-alerter-r5fkk\" (UID: \"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555\") " pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906652    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-sysctl-conf\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906685    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-conf-dir\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906714    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-etc-kubernetes\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.906909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906712    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-sys-fs\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906748    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906769    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906783    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-systemd\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906799    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b78c0dba-b7d9-4361-95f2-c0990578e1e6-serviceca\") pod \"node-ca-fsnhz\" (UID: \"b78c0dba-b7d9-4361-95f2-c0990578e1e6\") " pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906797    2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906817    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-tuned\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906822    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-modprobe-d\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906833    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c37c5a75-2bfd-4e08-ae2d-8793eb0b6555-host-slash\") pod \"iptables-alerter-r5fkk\" (UID: \"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555\") " pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906851    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49fb854d-b686-4dc6-acc0-0e3c17a1fae1-tmp-dir\") pod \"node-resolver-jr95w\" (UID: \"49fb854d-b686-4dc6-acc0-0e3c17a1fae1\") " pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906854    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-host\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906868    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-daemon-config\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906886    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-etc-openvswitch\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906891    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-slash\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906911    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-cni-bin\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906921    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-system-cni-dir\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906929    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7485b6d6-5852-4818-a6aa-e85e9a6189a9-cni-binary-copy\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906947    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-registration-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.907649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906963    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-kubelet\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906979    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-var-lib-openvswitch\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.906996    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907013    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49fb854d-b686-4dc6-acc0-0e3c17a1fae1-hosts-file\") pod \"node-resolver-jr95w\" (UID: \"49fb854d-b686-4dc6-acc0-0e3c17a1fae1\") " pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907028    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-systemd-units\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907045    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46d16632-292e-409c-a90d-931eb85e6e88-cni-binary-copy\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907067    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-sys\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907098    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-var-lib-kubelet\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907107    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-run-netns\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907120    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qhnk\" (UniqueName: \"kubernetes.io/projected/7485b6d6-5852-4818-a6aa-e85e9a6189a9-kube-api-access-5qhnk\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907164    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-cni-netd\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907188    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed1210a9-c2dc-4164-8fd8-0bf75730917c-ovn-node-metrics-cert\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907190    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-kubernetes\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907220    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dgh\" (UniqueName: \"kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh\") pod \"network-check-target-vhzqm\" (UID: \"648080a2-3ab7-4a37-9369-4ee8309eb43d\") " pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907251    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-var-lib-cni-bin\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907270    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-sysctl-d\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907286    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-socket-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.908562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907302    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-device-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907318    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed1210a9-c2dc-4164-8fd8-0bf75730917c-ovnkube-script-lib\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907336    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm4d7\" (UniqueName: \"kubernetes.io/projected/46d16632-292e-409c-a90d-931eb85e6e88-kube-api-access-tm4d7\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907352    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca0e813e-f648-4852-b34e-6e7e90b68421-tmp\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907370    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v9ml\" (UniqueName: \"kubernetes.io/projected/49fb854d-b686-4dc6-acc0-0e3c17a1fae1-kube-api-access-5v9ml\") pod \"node-resolver-jr95w\" (UID: \"49fb854d-b686-4dc6-acc0-0e3c17a1fae1\") " pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907394    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-run-k8s-cni-cncf-io\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907398    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46d16632-292e-409c-a90d-931eb85e6e88-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907421    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-cnibin\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907440    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-node-log\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907465    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-run\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907475    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907505    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-run-netns\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907548    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-run-multus-certs\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907513    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-os-release\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907577    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-cni-dir\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907600    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-var-lib-cni-multus\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907423    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-hostroot\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907634    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-cnibin\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.909359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907659    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-socket-dir-parent\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907678    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-lib-modules\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907686    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-dbus\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907714    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907720    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-var-lib-kubelet\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907744    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk8t2\" (UniqueName: \"kubernetes.io/projected/ca0e813e-f648-4852-b34e-6e7e90b68421-kube-api-access-sk8t2\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907768    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-run-openvswitch\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907793    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-log-socket\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907850    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-log-socket\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907887    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-cnibin\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907916    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-socket-dir-parent\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907946    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-dbus\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908015    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908016    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-etc-openvswitch\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908052    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-cni-bin\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908403    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7485b6d6-5852-4818-a6aa-e85e9a6189a9-multus-daemon-config\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908462    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-run-ovn\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908466    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7485b6d6-5852-4818-a6aa-e85e9a6189a9-cni-binary-copy\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.910379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908501    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-registration-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908537    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-kubelet\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908565    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-var-lib-openvswitch\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908583    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-run-openvswitch\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.908628    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.908685    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret podName:7b3855d2-11ab-4755-b1a8-8c04ed3bab7e nodeName:}" failed. No retries permitted until 2026-07-28 01:04:30.408669689 +0000 UTC m=+3.022977739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret") pod "global-pull-secret-syncer-vlsb4" (UID: "7b3855d2-11ab-4755-b1a8-8c04ed3bab7e") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908831    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-systemd-units\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908842    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed1210a9-c2dc-4164-8fd8-0bf75730917c-env-overrides\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908891    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b78c0dba-b7d9-4361-95f2-c0990578e1e6-host\") pod \"node-ca-fsnhz\" (UID: \"b78c0dba-b7d9-4361-95f2-c0990578e1e6\") " pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908893    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-var-lib-kubelet\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908915    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-var-lib-cni-bin\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.908961    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-os-release\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909005    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-sysctl-d\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909085    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46d16632-292e-409c-a90d-931eb85e6e88-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909112    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-socket-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909155    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-system-cni-dir\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909176    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-sysconfig\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.911302 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909186    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-device-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909228    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed1210a9-c2dc-4164-8fd8-0bf75730917c-host-cni-netd\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909685    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b78c0dba-b7d9-4361-95f2-c0990578e1e6-serviceca\") pod \"node-ca-fsnhz\" (UID: \"b78c0dba-b7d9-4361-95f2-c0990578e1e6\") " pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909741    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-etc-kubernetes\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909764    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed1210a9-c2dc-4164-8fd8-0bf75730917c-ovnkube-script-lib\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909794    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb57a35c-1920-4e4d-a1d2-267511f02cbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.909864    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.909910    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs podName:b55dc23e-8f3c-41ba-9d22-d3bd76112806 nodeName:}" failed. No retries permitted until 2026-07-28 01:04:30.409894665 +0000 UTC m=+3.024202720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs") pod "network-metrics-daemon-wj5vw" (UID: "b55dc23e-8f3c-41ba-9d22-d3bd76112806") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.909958    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-systemd\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.910187    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-host-run-k8s-cni-cncf-io\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.910249    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed1210a9-c2dc-4164-8fd8-0bf75730917c-ovn-node-metrics-cert\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.910404    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c37c5a75-2bfd-4e08-ae2d-8793eb0b6555-host-slash\") pod \"iptables-alerter-r5fkk\" (UID: \"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555\") " pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.910560    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5036ccb-ced6-4454-8216-7a43d1f73774-agent-certs\") pod \"konnectivity-agent-5shbb\" (UID: \"f5036ccb-ced6-4454-8216-7a43d1f73774\") " pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.907466    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7485b6d6-5852-4818-a6aa-e85e9a6189a9-hostroot\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.910650    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca0e813e-f648-4852-b34e-6e7e90b68421-sys\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.910880    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46d16632-292e-409c-a90d-931eb85e6e88-cni-binary-copy\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.910988    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46d16632-292e-409c-a90d-931eb85e6e88-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.911969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.911355    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c37c5a75-2bfd-4e08-ae2d-8793eb0b6555-iptables-alerter-script\") pod \"iptables-alerter-r5fkk\" (UID: \"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555\") " pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:29.912559 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.911893    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca0e813e-f648-4852-b34e-6e7e90b68421-etc-tuned\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.913325 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.913053    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca0e813e-f648-4852-b34e-6e7e90b68421-tmp\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.915649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.915624    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw55b\" (UniqueName: \"kubernetes.io/projected/ed1210a9-c2dc-4164-8fd8-0bf75730917c-kube-api-access-jw55b\") pod \"ovnkube-node-k2999\" (UID: \"ed1210a9-c2dc-4164-8fd8-0bf75730917c\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:29.916009 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.915986    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kchwp\" (UniqueName: \"kubernetes.io/projected/b78c0dba-b7d9-4361-95f2-c0990578e1e6-kube-api-access-kchwp\") pod \"node-ca-fsnhz\" (UID: \"b78c0dba-b7d9-4361-95f2-c0990578e1e6\") " pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:29.916510 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.916489    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fs55\" (UniqueName: \"kubernetes.io/projected/cb57a35c-1920-4e4d-a1d2-267511f02cbd-kube-api-access-2fs55\") pod \"aws-ebs-csi-driver-node-7h64p\" (UID: \"cb57a35c-1920-4e4d-a1d2-267511f02cbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:29.917524 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.917506    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:04:29.917617 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.917532    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:04:29.917617 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.917545    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s2dgh for pod openshift-network-diagnostics/network-check-target-vhzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:29.917617 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:29.917599    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh podName:648080a2-3ab7-4a37-9369-4ee8309eb43d nodeName:}" failed. No retries permitted until 2026-07-28 01:04:30.417582182 +0000 UTC m=+3.031890239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dgh" (UniqueName: "kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh") pod "network-check-target-vhzqm" (UID: "648080a2-3ab7-4a37-9369-4ee8309eb43d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:29.918385 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.918364    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm4d7\" (UniqueName: \"kubernetes.io/projected/46d16632-292e-409c-a90d-931eb85e6e88-kube-api-access-tm4d7\") pod \"multus-additional-cni-plugins-8blwn\" (UID: \"46d16632-292e-409c-a90d-931eb85e6e88\") " pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:29.918603 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.918549    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qhnk\" (UniqueName: \"kubernetes.io/projected/7485b6d6-5852-4818-a6aa-e85e9a6189a9-kube-api-access-5qhnk\") pod \"multus-sb7r5\" (UID: \"7485b6d6-5852-4818-a6aa-e85e9a6189a9\") " pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:29.918785 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.918765    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk8t2\" (UniqueName: \"kubernetes.io/projected/ca0e813e-f648-4852-b34e-6e7e90b68421-kube-api-access-sk8t2\") pod \"tuned-smkjs\" (UID: \"ca0e813e-f648-4852-b34e-6e7e90b68421\") " pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:29.919054 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:29.919032    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62jzt\" (UniqueName: \"kubernetes.io/projected/b55dc23e-8f3c-41ba-9d22-d3bd76112806-kube-api-access-62jzt\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:30.008653 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.008615    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49fb854d-b686-4dc6-acc0-0e3c17a1fae1-hosts-file\") pod \"node-resolver-jr95w\" (UID: \"49fb854d-b686-4dc6-acc0-0e3c17a1fae1\") " pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:30.008653 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.008671    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9ml\" (UniqueName: \"kubernetes.io/projected/49fb854d-b686-4dc6-acc0-0e3c17a1fae1-kube-api-access-5v9ml\") pod \"node-resolver-jr95w\" (UID: \"49fb854d-b686-4dc6-acc0-0e3c17a1fae1\") " pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:30.008903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.008704    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crnlz\" (UniqueName: \"kubernetes.io/projected/c37c5a75-2bfd-4e08-ae2d-8793eb0b6555-kube-api-access-crnlz\") pod \"iptables-alerter-r5fkk\" (UID: \"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555\") " pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:30.008903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.008740    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49fb854d-b686-4dc6-acc0-0e3c17a1fae1-tmp-dir\") pod \"node-resolver-jr95w\" (UID: \"49fb854d-b686-4dc6-acc0-0e3c17a1fae1\") " pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:30.008903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.008746    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49fb854d-b686-4dc6-acc0-0e3c17a1fae1-hosts-file\") pod \"node-resolver-jr95w\" (UID: \"49fb854d-b686-4dc6-acc0-0e3c17a1fae1\") " pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:30.009187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.009161    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49fb854d-b686-4dc6-acc0-0e3c17a1fae1-tmp-dir\") pod \"node-resolver-jr95w\" (UID: \"49fb854d-b686-4dc6-acc0-0e3c17a1fae1\") " pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:30.017906 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.017839    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v9ml\" (UniqueName: \"kubernetes.io/projected/49fb854d-b686-4dc6-acc0-0e3c17a1fae1-kube-api-access-5v9ml\") pod \"node-resolver-jr95w\" (UID: \"49fb854d-b686-4dc6-acc0-0e3c17a1fae1\") " pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:30.018030 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.017925    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crnlz\" (UniqueName: \"kubernetes.io/projected/c37c5a75-2bfd-4e08-ae2d-8793eb0b6555-kube-api-access-crnlz\") pod \"iptables-alerter-r5fkk\" (UID: \"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555\") " pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:30.088419 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.088381    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fsnhz"
Jul 28 01:04:30.098028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.097998    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8blwn"
Jul 28 01:04:30.108291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.108262    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sb7r5"
Jul 28 01:04:30.113395 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.113374    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p"
Jul 28 01:04:30.121459 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.121428    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smkjs"
Jul 28 01:04:30.128622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.128602    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r5fkk"
Jul 28 01:04:30.137940 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.137920    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:30.143261 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.143238    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:30.150098 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.150075    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jr95w"
Jul 28 01:04:30.412187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.412087    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:30.412356 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.412190    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:30.412356 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:30.412268    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:30.412356 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:30.412305    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:30.412356 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:30.412343    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret podName:7b3855d2-11ab-4755-b1a8-8c04ed3bab7e nodeName:}" failed. No retries permitted until 2026-07-28 01:04:31.412318402 +0000 UTC m=+4.026626455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret") pod "global-pull-secret-syncer-vlsb4" (UID: "7b3855d2-11ab-4755-b1a8-8c04ed3bab7e") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:30.412563 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:30.412364    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs podName:b55dc23e-8f3c-41ba-9d22-d3bd76112806 nodeName:}" failed. No retries permitted until 2026-07-28 01:04:31.412353762 +0000 UTC m=+4.026661813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs") pod "network-metrics-daemon-wj5vw" (UID: "b55dc23e-8f3c-41ba-9d22-d3bd76112806") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:30.512576 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.512545    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dgh\" (UniqueName: \"kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh\") pod \"network-check-target-vhzqm\" (UID: \"648080a2-3ab7-4a37-9369-4ee8309eb43d\") " pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:30.512747 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:30.512725    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:04:30.512832 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:30.512758    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:04:30.512832 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:30.512772    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s2dgh for pod openshift-network-diagnostics/network-check-target-vhzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:30.512931 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:30.512846    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh podName:648080a2-3ab7-4a37-9369-4ee8309eb43d nodeName:}" failed. No retries permitted until 2026-07-28 01:04:31.512824926 +0000 UTC m=+4.127132991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dgh" (UniqueName: "kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh") pod "network-check-target-vhzqm" (UID: "648080a2-3ab7-4a37-9369-4ee8309eb43d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:30.832628 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.832554    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 00:59:29 +0000 UTC" deadline="2028-01-29 13:35:01.354883021 +0000 UTC"
Jul 28 01:04:30.832628 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:30.832588    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13212h30m30.522298866s"
Jul 28 01:04:30.869725 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:30.869699    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78c0dba_b7d9_4361_95f2_c0990578e1e6.slice/crio-bad7d8011c0eb2ee4f83832eed10e0301631dbece898387ce60dd3d92892db4b WatchSource:0}: Error finding container bad7d8011c0eb2ee4f83832eed10e0301631dbece898387ce60dd3d92892db4b: Status 404 returned error can't find the container with id bad7d8011c0eb2ee4f83832eed10e0301631dbece898387ce60dd3d92892db4b
Jul 28 01:04:30.871735 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:30.871715    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49fb854d_b686_4dc6_acc0_0e3c17a1fae1.slice/crio-14ad688d77f7a02f32113c5047d95dd613ad2eefcc55633db10745880742900b WatchSource:0}: Error finding container 14ad688d77f7a02f32113c5047d95dd613ad2eefcc55633db10745880742900b: Status 404 returned error can't find the container with id 14ad688d77f7a02f32113c5047d95dd613ad2eefcc55633db10745880742900b
Jul 28 01:04:30.872708 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:30.872681    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc37c5a75_2bfd_4e08_ae2d_8793eb0b6555.slice/crio-278edcfdff0b1b04736c7f888309141937d5654d91a07ddc9cf67b385951a015 WatchSource:0}: Error finding container 278edcfdff0b1b04736c7f888309141937d5654d91a07ddc9cf67b385951a015: Status 404 returned error can't find the container with id 278edcfdff0b1b04736c7f888309141937d5654d91a07ddc9cf67b385951a015
Jul 28 01:04:30.878309 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:30.878149    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d16632_292e_409c_a90d_931eb85e6e88.slice/crio-23d4256d40448143c80423adbe80e3fd3d84f53593d0fa9bc7a55a6701c74c1a WatchSource:0}: Error finding container 23d4256d40448143c80423adbe80e3fd3d84f53593d0fa9bc7a55a6701c74c1a: Status 404 returned error can't find the container with id 23d4256d40448143c80423adbe80e3fd3d84f53593d0fa9bc7a55a6701c74c1a
Jul 28 01:04:30.878542 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:30.878517    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7485b6d6_5852_4818_a6aa_e85e9a6189a9.slice/crio-cd57b09f8605797d2440414543146d07bdc721085b79e9c392d9804a3eabfc7a WatchSource:0}: Error finding container cd57b09f8605797d2440414543146d07bdc721085b79e9c392d9804a3eabfc7a: Status 404 returned error can't find the container with id cd57b09f8605797d2440414543146d07bdc721085b79e9c392d9804a3eabfc7a
Jul 28 01:04:30.882750 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:30.882727    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5036ccb_ced6_4454_8216_7a43d1f73774.slice/crio-7e4f2f67f38eab4303ab4188764492f5e0f5402ef6251e697df44bdd40e7bbb4 WatchSource:0}: Error finding container 7e4f2f67f38eab4303ab4188764492f5e0f5402ef6251e697df44bdd40e7bbb4: Status 404 returned error can't find the container with id 7e4f2f67f38eab4303ab4188764492f5e0f5402ef6251e697df44bdd40e7bbb4
Jul 28 01:04:30.882963 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:30.882943    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb57a35c_1920_4e4d_a1d2_267511f02cbd.slice/crio-f4d8ab6db56383b5674d987e137abdd4c4734091824241b3fc04cee1cc458cd6 WatchSource:0}: Error finding container f4d8ab6db56383b5674d987e137abdd4c4734091824241b3fc04cee1cc458cd6: Status 404 returned error can't find the container with id f4d8ab6db56383b5674d987e137abdd4c4734091824241b3fc04cee1cc458cd6
Jul 28 01:04:30.884611 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:30.884536    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1210a9_c2dc_4164_8fd8_0bf75730917c.slice/crio-70987f6a331f024417aac20be304e92302c82d25686cb1bceb2afb7b5ec325cb WatchSource:0}: Error finding container 70987f6a331f024417aac20be304e92302c82d25686cb1bceb2afb7b5ec325cb: Status 404 returned error can't find the container with id 70987f6a331f024417aac20be304e92302c82d25686cb1bceb2afb7b5ec325cb
Jul 28 01:04:30.886033 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:04:30.885688    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0e813e_f648_4852_b34e_6e7e90b68421.slice/crio-9e95f5be4b8a8d999738df59a9ca861160e68150004879cf98268f6060781be8 WatchSource:0}: Error finding container 9e95f5be4b8a8d999738df59a9ca861160e68150004879cf98268f6060781be8: Status 404 returned error can't find the container with id 9e95f5be4b8a8d999738df59a9ca861160e68150004879cf98268f6060781be8
Jul 28 01:04:31.024642 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.024454    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r5fkk" event={"ID":"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555","Type":"ContainerStarted","Data":"278edcfdff0b1b04736c7f888309141937d5654d91a07ddc9cf67b385951a015"}
Jul 28 01:04:31.025584 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.025555    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jr95w" event={"ID":"49fb854d-b686-4dc6-acc0-0e3c17a1fae1","Type":"ContainerStarted","Data":"14ad688d77f7a02f32113c5047d95dd613ad2eefcc55633db10745880742900b"}
Jul 28 01:04:31.032257 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.032229    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fsnhz" event={"ID":"b78c0dba-b7d9-4361-95f2-c0990578e1e6","Type":"ContainerStarted","Data":"bad7d8011c0eb2ee4f83832eed10e0301631dbece898387ce60dd3d92892db4b"}
Jul 28 01:04:31.036111 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.036074    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" event={"ID":"5335f321bbdc98b925d1a74da4b1481d","Type":"ContainerStarted","Data":"96593a83154371fb75e727f2e06e6dccb2dd911dcc017aed57de80ce95df8013"}
Jul 28 01:04:31.038185 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.038161    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smkjs" event={"ID":"ca0e813e-f648-4852-b34e-6e7e90b68421","Type":"ContainerStarted","Data":"9e95f5be4b8a8d999738df59a9ca861160e68150004879cf98268f6060781be8"}
Jul 28 01:04:31.040503 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.040479    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sb7r5" event={"ID":"7485b6d6-5852-4818-a6aa-e85e9a6189a9","Type":"ContainerStarted","Data":"cd57b09f8605797d2440414543146d07bdc721085b79e9c392d9804a3eabfc7a"}
Jul 28 01:04:31.041579 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.041557    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5shbb" event={"ID":"f5036ccb-ced6-4454-8216-7a43d1f73774","Type":"ContainerStarted","Data":"7e4f2f67f38eab4303ab4188764492f5e0f5402ef6251e697df44bdd40e7bbb4"}
Jul 28 01:04:31.043010 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.042991    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p" event={"ID":"cb57a35c-1920-4e4d-a1d2-267511f02cbd","Type":"ContainerStarted","Data":"f4d8ab6db56383b5674d987e137abdd4c4734091824241b3fc04cee1cc458cd6"}
Jul 28 01:04:31.044157 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.044120    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2999" event={"ID":"ed1210a9-c2dc-4164-8fd8-0bf75730917c","Type":"ContainerStarted","Data":"70987f6a331f024417aac20be304e92302c82d25686cb1bceb2afb7b5ec325cb"}
Jul 28 01:04:31.045109 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.045088    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8blwn" event={"ID":"46d16632-292e-409c-a90d-931eb85e6e88","Type":"ContainerStarted","Data":"23d4256d40448143c80423adbe80e3fd3d84f53593d0fa9bc7a55a6701c74c1a"}
Jul 28 01:04:31.051757 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.051532    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" podStartSLOduration=2.051516541 podStartE2EDuration="2.051516541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:31.05098467 +0000 UTC m=+3.665292741" watchObservedRunningTime="2026-07-28 01:04:31.051516541 +0000 UTC m=+3.665824614"
Jul 28 01:04:31.419394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.419311    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:31.419394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.419374    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:31.419602 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:31.419510    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:31.419602 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:31.419571    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret podName:7b3855d2-11ab-4755-b1a8-8c04ed3bab7e nodeName:}" failed. No retries permitted until 2026-07-28 01:04:33.419552209 +0000 UTC m=+6.033860262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret") pod "global-pull-secret-syncer-vlsb4" (UID: "7b3855d2-11ab-4755-b1a8-8c04ed3bab7e") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:31.419969 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:31.419950    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:31.420048 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:31.419996    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs podName:b55dc23e-8f3c-41ba-9d22-d3bd76112806 nodeName:}" failed. No retries permitted until 2026-07-28 01:04:33.419981328 +0000 UTC m=+6.034289386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs") pod "network-metrics-daemon-wj5vw" (UID: "b55dc23e-8f3c-41ba-9d22-d3bd76112806") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:31.521226 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.520608    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dgh\" (UniqueName: \"kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh\") pod \"network-check-target-vhzqm\" (UID: \"648080a2-3ab7-4a37-9369-4ee8309eb43d\") " pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:31.521226 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:31.520778    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:04:31.521226 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:31.520804    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:04:31.521226 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:31.520818    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s2dgh for pod openshift-network-diagnostics/network-check-target-vhzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:31.521226 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:31.520881    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh podName:648080a2-3ab7-4a37-9369-4ee8309eb43d nodeName:}" failed. No retries permitted until 2026-07-28 01:04:33.520863029 +0000 UTC m=+6.135171100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dgh" (UniqueName: "kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh") pod "network-check-target-vhzqm" (UID: "648080a2-3ab7-4a37-9369-4ee8309eb43d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:31.833476 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.833362    2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 00:59:29 +0000 UTC" deadline="2028-04-09 14:17:11.637765194 +0000 UTC"
Jul 28 01:04:31.833476 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:31.833427    2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14917h12m39.804342497s"
Jul 28 01:04:32.027151 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:32.027107    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:32.027716 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:32.027688    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:32.027803 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:32.027286    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:32.027854 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:32.027796    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:32.027854 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:32.027204    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:32.027945 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:32.027869    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:32.061410 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:32.061375    2552 generic.go:356] "Generic (PLEG): container finished" podID="98b2f14a2e561079373fe06316702acf" containerID="5c6fa18abbb01abc22521f5a8881005ba1eb2e9ed828de193e9f18b17474b01b" exitCode=0
Jul 28 01:04:32.062233 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:32.062168    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" event={"ID":"98b2f14a2e561079373fe06316702acf","Type":"ContainerDied","Data":"5c6fa18abbb01abc22521f5a8881005ba1eb2e9ed828de193e9f18b17474b01b"}
Jul 28 01:04:33.106177 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:33.105446    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" event={"ID":"98b2f14a2e561079373fe06316702acf","Type":"ContainerStarted","Data":"6126627cd805c6ea8cd813199504e8c33ffa79508529ada17b0124e357aa45cf"}
Jul 28 01:04:33.440578 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:33.439708    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:33.440578 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:33.439789    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:33.440578 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:33.439906    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:33.440578 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:33.439982    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret podName:7b3855d2-11ab-4755-b1a8-8c04ed3bab7e nodeName:}" failed. No retries permitted until 2026-07-28 01:04:37.439963332 +0000 UTC m=+10.054271386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret") pod "global-pull-secret-syncer-vlsb4" (UID: "7b3855d2-11ab-4755-b1a8-8c04ed3bab7e") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:33.440578 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:33.440415    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:33.440578 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:33.440462    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs podName:b55dc23e-8f3c-41ba-9d22-d3bd76112806 nodeName:}" failed. No retries permitted until 2026-07-28 01:04:37.44044733 +0000 UTC m=+10.054755385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs") pod "network-metrics-daemon-wj5vw" (UID: "b55dc23e-8f3c-41ba-9d22-d3bd76112806") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:33.540526 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:33.540485    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dgh\" (UniqueName: \"kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh\") pod \"network-check-target-vhzqm\" (UID: \"648080a2-3ab7-4a37-9369-4ee8309eb43d\") " pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:33.540699 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:33.540661    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:04:33.540699 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:33.540684    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:04:33.540699 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:33.540697    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s2dgh for pod openshift-network-diagnostics/network-check-target-vhzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:33.540864 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:33.540753    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh podName:648080a2-3ab7-4a37-9369-4ee8309eb43d nodeName:}" failed. No retries permitted until 2026-07-28 01:04:37.540736196 +0000 UTC m=+10.155044251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dgh" (UniqueName: "kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh") pod "network-check-target-vhzqm" (UID: "648080a2-3ab7-4a37-9369-4ee8309eb43d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:34.018021 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:34.017264    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:34.018021 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:34.017394    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:34.018021 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:34.017808    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:34.018021 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:34.017899    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:34.018382 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:34.018326    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:34.018439 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:34.018418    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:36.017275 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:36.017240    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:36.017692 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:36.017410    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:36.017692 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:36.017429    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:36.017692 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:36.017488    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:36.017692 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:36.017545    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:36.017692 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:36.017642    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:37.476624 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:37.476589    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:37.477087 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:37.476636    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:37.477087 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:37.476743    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:37.477087 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:37.476770    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:37.477087 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:37.476816    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret podName:7b3855d2-11ab-4755-b1a8-8c04ed3bab7e nodeName:}" failed. No retries permitted until 2026-07-28 01:04:45.476798371 +0000 UTC m=+18.091106421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret") pod "global-pull-secret-syncer-vlsb4" (UID: "7b3855d2-11ab-4755-b1a8-8c04ed3bab7e") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:37.477087 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:37.476839    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs podName:b55dc23e-8f3c-41ba-9d22-d3bd76112806 nodeName:}" failed. No retries permitted until 2026-07-28 01:04:45.476827804 +0000 UTC m=+18.091135855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs") pod "network-metrics-daemon-wj5vw" (UID: "b55dc23e-8f3c-41ba-9d22-d3bd76112806") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:37.577655 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:37.577617    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dgh\" (UniqueName: \"kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh\") pod \"network-check-target-vhzqm\" (UID: \"648080a2-3ab7-4a37-9369-4ee8309eb43d\") " pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:37.577834 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:37.577804    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:04:37.577834 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:37.577827    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:04:37.577904 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:37.577840    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s2dgh for pod openshift-network-diagnostics/network-check-target-vhzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:37.577904 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:37.577896    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh podName:648080a2-3ab7-4a37-9369-4ee8309eb43d nodeName:}" failed. No retries permitted until 2026-07-28 01:04:45.5778771 +0000 UTC m=+18.192185161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dgh" (UniqueName: "kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh") pod "network-check-target-vhzqm" (UID: "648080a2-3ab7-4a37-9369-4ee8309eb43d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:38.018328 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:38.018285    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:38.018498 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:38.018386    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:38.018498 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:38.018396    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:38.018498 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:38.018479    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:38.018614 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:38.018501    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:38.018670 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:38.018651    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:40.018648 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:40.016077    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:40.018648 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:40.016218    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:40.018648 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:40.016546    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:40.018648 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:40.016617    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:40.018648 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:40.016653    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:40.018648 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:40.016720    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:42.019092 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:42.019062    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:42.019529 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:42.019062    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:42.019529 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:42.019202    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:42.019529 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:42.019062    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:42.019529 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:42.019266    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:42.019529 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:42.019338    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:44.016515 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:44.016463    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:44.016515 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:44.016470    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:44.017048 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:44.016614    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:44.017048 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:44.016624    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:44.017048 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:44.016728    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:44.017048 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:44.016818    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:45.537741 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:45.537704    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:45.538173 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:45.537763    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:45.538173 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:45.537887    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:45.538173 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:45.537923    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:45.538173 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:45.537961    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs podName:b55dc23e-8f3c-41ba-9d22-d3bd76112806 nodeName:}" failed. No retries permitted until 2026-07-28 01:05:01.537946528 +0000 UTC m=+34.152254578 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs") pod "network-metrics-daemon-wj5vw" (UID: "b55dc23e-8f3c-41ba-9d22-d3bd76112806") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:04:45.538173 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:45.537989    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret podName:7b3855d2-11ab-4755-b1a8-8c04ed3bab7e nodeName:}" failed. No retries permitted until 2026-07-28 01:05:01.537970789 +0000 UTC m=+34.152278839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret") pod "global-pull-secret-syncer-vlsb4" (UID: "7b3855d2-11ab-4755-b1a8-8c04ed3bab7e") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:04:45.638422 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:45.638389    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dgh\" (UniqueName: \"kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh\") pod \"network-check-target-vhzqm\" (UID: \"648080a2-3ab7-4a37-9369-4ee8309eb43d\") " pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:45.638583 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:45.638567    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:04:45.638638 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:45.638594    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:04:45.638638 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:45.638609    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s2dgh for pod openshift-network-diagnostics/network-check-target-vhzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:45.638712 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:45.638665    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh podName:648080a2-3ab7-4a37-9369-4ee8309eb43d nodeName:}" failed. No retries permitted until 2026-07-28 01:05:01.638651641 +0000 UTC m=+34.252959690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dgh" (UniqueName: "kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh") pod "network-check-target-vhzqm" (UID: "648080a2-3ab7-4a37-9369-4ee8309eb43d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:04:46.016062 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:46.015987    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:46.016062 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:46.016040    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:46.016062 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:46.016056    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:46.016334 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:46.016202    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:46.016334 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:46.016271    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:46.016448 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:46.016352    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:48.017221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:48.016709    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:48.017221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:48.016825    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:48.017221 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:48.016842    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:48.017221 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:48.016957    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:48.017221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:48.017019    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:48.017221 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:48.017093    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:50.016234 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.016011    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:50.017061 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:50.016310    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:50.017061 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.016166    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:50.017061 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:50.016371    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:50.017061 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.016011    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:50.017061 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:50.016421    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:50.140802 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.140679    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sb7r5" event={"ID":"7485b6d6-5852-4818-a6aa-e85e9a6189a9","Type":"ContainerStarted","Data":"11a002a74e4cfd7ce7cfd630970e92a7fc6787cd86acc0483adb01285f86de30"}
Jul 28 01:04:50.142524 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.142205    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5shbb" event={"ID":"f5036ccb-ced6-4454-8216-7a43d1f73774","Type":"ContainerStarted","Data":"2c79e85b3fcef95f1a7db5c6e86f90059825634911027624a9b6c38f9d49cb8d"}
Jul 28 01:04:50.143663 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.143636    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p" event={"ID":"cb57a35c-1920-4e4d-a1d2-267511f02cbd","Type":"ContainerStarted","Data":"526fd69901113b3eee71a5f75f82a593bf5e6bab28c9c96a929f9555b11cff9f"}
Jul 28 01:04:50.147016 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.146993    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2999" event={"ID":"ed1210a9-c2dc-4164-8fd8-0bf75730917c","Type":"ContainerStarted","Data":"0e2359687f55ce52b99813ca23b49e05ff5f6ddd1ccc1b4631d001422046d921"}
Jul 28 01:04:50.147155 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.147065    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2999" event={"ID":"ed1210a9-c2dc-4164-8fd8-0bf75730917c","Type":"ContainerStarted","Data":"964ff51b2ec6659a791bcc6e3b16c5568fb9fa8225d9cc814b1c25a5db0f1b33"}
Jul 28 01:04:50.147155 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.147116    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2999" event={"ID":"ed1210a9-c2dc-4164-8fd8-0bf75730917c","Type":"ContainerStarted","Data":"9000fdae5c749ecc2d871a9fb11045fe7b911df8df51337461e38c30108700a7"}
Jul 28 01:04:50.147281 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.147188    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2999" event={"ID":"ed1210a9-c2dc-4164-8fd8-0bf75730917c","Type":"ContainerStarted","Data":"fca45d45df1e6046506943fe7bade987477566a1f8e4663719930e21dd3225fc"}
Jul 28 01:04:50.147281 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.147239    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2999" event={"ID":"ed1210a9-c2dc-4164-8fd8-0bf75730917c","Type":"ContainerStarted","Data":"1b59224ae3ecee9a022ec1ef0eeb6679ab6863a8ecb3d70f99d053406427d6a4"}
Jul 28 01:04:50.147378 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.147286    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2999" event={"ID":"ed1210a9-c2dc-4164-8fd8-0bf75730917c","Type":"ContainerStarted","Data":"b2156e234d92f50420b5813bb8f7a54b9dc8dc846f4bbefe075c6ade96a044e3"}
Jul 28 01:04:50.148624 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.148602    2552 generic.go:356] "Generic (PLEG): container finished" podID="46d16632-292e-409c-a90d-931eb85e6e88" containerID="39297c2fb1dbbe50de5883696b23b8b85ba9f5a0583774c315b2da9b3b7600c6" exitCode=0
Jul 28 01:04:50.148727 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.148688    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8blwn" event={"ID":"46d16632-292e-409c-a90d-931eb85e6e88","Type":"ContainerDied","Data":"39297c2fb1dbbe50de5883696b23b8b85ba9f5a0583774c315b2da9b3b7600c6"}
Jul 28 01:04:50.150303 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.150266    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jr95w" event={"ID":"49fb854d-b686-4dc6-acc0-0e3c17a1fae1","Type":"ContainerStarted","Data":"cfa92afdfb6d2b7656bd9c07938ed5c23a86c71584356a8701e67b67359f2f14"}
Jul 28 01:04:50.151957 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.151935    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fsnhz" event={"ID":"b78c0dba-b7d9-4361-95f2-c0990578e1e6","Type":"ContainerStarted","Data":"a4d3b7819f48ca24023e2ddcaab9a9c7c3698f7aa620c37def88a4442c975f41"}
Jul 28 01:04:50.153525 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.153503    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smkjs" event={"ID":"ca0e813e-f648-4852-b34e-6e7e90b68421","Type":"ContainerStarted","Data":"45ac05c659e63724543d487d6edef25839e901ab2f94b478b3589980859bff32"}
Jul 28 01:04:50.159455 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.159409    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" podStartSLOduration=22.159373272 podStartE2EDuration="22.159373272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:33.121055918 +0000 UTC m=+5.735364034" watchObservedRunningTime="2026-07-28 01:04:50.159373272 +0000 UTC m=+22.773681334"
Jul 28 01:04:50.159669 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.159640    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sb7r5" podStartSLOduration=4.56777404 podStartE2EDuration="23.159628366s" totalImagesPullingTime="18.591854326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:50.15959765 +0000 UTC m=+22.773905721" watchObservedRunningTime="2026-07-28 01:04:50.159628366 +0000 UTC m=+22.773936437"
Jul 28 01:04:50.217970 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.217925    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fsnhz" podStartSLOduration=4.634951941 podStartE2EDuration="23.21791193s" totalImagesPullingTime="18.582959989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:50.217876586 +0000 UTC m=+22.832184659" watchObservedRunningTime="2026-07-28 01:04:50.21791193 +0000 UTC m=+22.832220003"
Jul 28 01:04:50.218165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.218144    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-smkjs" podStartSLOduration=3.649390827 podStartE2EDuration="22.218126769s" totalImagesPullingTime="18.568735942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:50.201081842 +0000 UTC m=+22.815389909" watchObservedRunningTime="2026-07-28 01:04:50.218126769 +0000 UTC m=+22.832434840"
Jul 28 01:04:50.232669 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.232432    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5shbb" podStartSLOduration=8.202068363 podStartE2EDuration="22.232419575s" totalImagesPullingTime="14.030351212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:50.231877126 +0000 UTC m=+22.846185199" watchObservedRunningTime="2026-07-28 01:04:50.232419575 +0000 UTC m=+22.846727692"
Jul 28 01:04:50.246346 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.246299    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jr95w" podStartSLOduration=3.666790247 podStartE2EDuration="22.246283484s" totalImagesPullingTime="18.579493237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:50.24596144 +0000 UTC m=+22.860269514" watchObservedRunningTime="2026-07-28 01:04:50.246283484 +0000 UTC m=+22.860591556"
Jul 28 01:04:50.272946 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.272922    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:50.328166 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.328111    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:50.393377 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.393285    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:50.513448 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.513418    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:50.545682 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.545662    2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 01:04:50.584474 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.584455    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:50.584993 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.584977    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:50.603404 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.603373    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:50.869527 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.869426    2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T01:04:50.545676661Z","UUID":"d6584d3f-9e9d-455c-8d87-4c79f8586590","Handler":null,"Name":"","Endpoint":""}
Jul 28 01:04:50.871336 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.871316    2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 01:04:50.871445 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:50.871362    2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 01:04:51.124720 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.124625    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:51.159024 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.158987    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p" event={"ID":"cb57a35c-1920-4e4d-a1d2-267511f02cbd","Type":"ContainerStarted","Data":"134cd79a7942a00dc3487d3593d74a9cd773119f22f666b86f42b163181eb3d5"}
Jul 28 01:04:51.162037 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.162001    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r5fkk" event={"ID":"c37c5a75-2bfd-4e08-ae2d-8793eb0b6555","Type":"ContainerStarted","Data":"d2cc7279425b49771464506f47567ebdb1feec9c2ef07c9987d475e64d30a125"}
Jul 28 01:04:51.162568 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.162436    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:51.163021 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.162996    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5shbb"
Jul 28 01:04:51.173892 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.173827    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:51.177034 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.176730    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r5fkk" podStartSLOduration=4.597590381 podStartE2EDuration="23.176712258s" totalImagesPullingTime="18.579121877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:51.176262218 +0000 UTC m=+23.790570290" watchObservedRunningTime="2026-07-28 01:04:51.176712258 +0000 UTC m=+23.791020330"
Jul 28 01:04:51.233443 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.233402    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:51.333280 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.333247    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:51.434358 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.434266    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:51.749524 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.749429    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:51.800453 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.800355    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:51.891965 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:51.891937    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:04:52.015945 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:52.015858    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:52.016114 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:52.015859    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:52.016114 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:52.015990    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:52.016114 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:52.015863    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:52.016114 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:52.016062    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:52.016282 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:52.016120    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:52.167305 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:52.167262    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p" event={"ID":"cb57a35c-1920-4e4d-a1d2-267511f02cbd","Type":"ContainerStarted","Data":"af9dbec08a325debc252e1150c938a7728c52bbd69d75751b2ffc4c208b45199"}
Jul 28 01:04:52.172561 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:52.172531    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2999" event={"ID":"ed1210a9-c2dc-4164-8fd8-0bf75730917c","Type":"ContainerStarted","Data":"96b1691971b1d0c6e855fce3425b249e3c314493258463a98bd1c450051d7832"}
Jul 28 01:04:52.185242 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:52.185177    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7h64p" podStartSLOduration=4.124744496 podStartE2EDuration="24.185156417s" totalImagesPullingTime="20.060411921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:52.183689384 +0000 UTC m=+24.797997458" watchObservedRunningTime="2026-07-28 01:04:52.185156417 +0000 UTC m=+24.799464483"
Jul 28 01:04:54.015700 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:54.015490    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:54.016205 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:54.015490    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:54.016205 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:54.015782    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:54.016205 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:54.015526    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:54.016205 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:54.015900    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:54.016205 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:54.015952    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:55.181477 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:55.181225    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2999" event={"ID":"ed1210a9-c2dc-4164-8fd8-0bf75730917c","Type":"ContainerStarted","Data":"6ad51e938cbc689c888a35c9ee8799e568a511a624cac9e3d60153f79b46dd94"}
Jul 28 01:04:55.182038 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:55.181540    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:55.182038 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:55.181593    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:55.183925 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:55.183899    2552 generic.go:356] "Generic (PLEG): container finished" podID="46d16632-292e-409c-a90d-931eb85e6e88" containerID="ed60e4096fe6a1ed1105d4eb4e87f13d81c3442a741ef7c0185a9eba19244071" exitCode=0
Jul 28 01:04:55.184035 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:55.183942    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8blwn" event={"ID":"46d16632-292e-409c-a90d-931eb85e6e88","Type":"ContainerDied","Data":"ed60e4096fe6a1ed1105d4eb4e87f13d81c3442a741ef7c0185a9eba19244071"}
Jul 28 01:04:55.198270 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:55.198249    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:55.207958 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:55.207226    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k2999" podStartSLOduration=8.591393367 podStartE2EDuration="27.207204438s" totalImagesPullingTime="18.615811071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:55.20580745 +0000 UTC m=+27.820115523" watchObservedRunningTime="2026-07-28 01:04:55.207204438 +0000 UTC m=+27.821512511"
Jul 28 01:04:56.018728 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.018699    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:56.018962 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.018794    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:56.018962 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:56.018810    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:56.018962 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.018819    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:56.018962 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:56.018879    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:56.018962 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:56.018952    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:56.186594 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.186557    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:56.202619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.202595    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:04:56.335476 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.335446    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vlsb4"]
Jul 28 01:04:56.335630 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.335557    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:56.335681 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:56.335645    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:56.338566 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.338539    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vhzqm"]
Jul 28 01:04:56.338711 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.338631    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:56.338769 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:56.338714    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:56.339214 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.339191    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wj5vw"]
Jul 28 01:04:56.339334 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:56.339286    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:56.339415 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:56.339393    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:57.190234 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:57.190194    2552 generic.go:356] "Generic (PLEG): container finished" podID="46d16632-292e-409c-a90d-931eb85e6e88" containerID="a5cb7e8c73c9745d79e9a8e1b3c3bb2a440b4817ed6c3943c065b8505a92be2a" exitCode=0
Jul 28 01:04:57.190697 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:57.190249    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8blwn" event={"ID":"46d16632-292e-409c-a90d-931eb85e6e88","Type":"ContainerDied","Data":"a5cb7e8c73c9745d79e9a8e1b3c3bb2a440b4817ed6c3943c065b8505a92be2a"}
Jul 28 01:04:58.016685 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:58.016497    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:04:58.016855 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:58.016559    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:04:58.016855 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:58.016762    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:04:58.016855 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:58.016843    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:04:58.017104 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:58.016587    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:04:58.017104 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:04:58.016932    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:04:59.196327 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:59.196291    2552 generic.go:356] "Generic (PLEG): container finished" podID="46d16632-292e-409c-a90d-931eb85e6e88" containerID="db0878769af01528ac242bb1ccbed847f76cc258a5faef9e952449f2b556c778" exitCode=0
Jul 28 01:04:59.196863 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:04:59.196352    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8blwn" event={"ID":"46d16632-292e-409c-a90d-931eb85e6e88","Type":"ContainerDied","Data":"db0878769af01528ac242bb1ccbed847f76cc258a5faef9e952449f2b556c778"}
Jul 28 01:05:00.017171 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:00.016395    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:05:00.017171 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:00.016431    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:05:00.017171 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:00.016399    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:05:00.017171 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:00.016546    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:05:00.017171 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:00.016694    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:05:00.017171 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:00.016874    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:05:00.038824 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:00.038787    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:00.137352 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:00.137313    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:01.560774 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:01.560737    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:05:01.561423 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:01.560801    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:05:01.561423 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:01.560913    2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 01:05:01.561423 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:01.560965    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret podName:7b3855d2-11ab-4755-b1a8-8c04ed3bab7e nodeName:}" failed. No retries permitted until 2026-07-28 01:05:33.560951167 +0000 UTC m=+66.175259228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret") pod "global-pull-secret-syncer-vlsb4" (UID: "7b3855d2-11ab-4755-b1a8-8c04ed3bab7e") : object "kube-system"/"original-pull-secret" not registered
Jul 28 01:05:01.561423 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:01.560912    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:05:01.561423 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:01.561041    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs podName:b55dc23e-8f3c-41ba-9d22-d3bd76112806 nodeName:}" failed. No retries permitted until 2026-07-28 01:05:33.561026263 +0000 UTC m=+66.175334323 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs") pod "network-metrics-daemon-wj5vw" (UID: "b55dc23e-8f3c-41ba-9d22-d3bd76112806") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 01:05:01.662089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:01.662052    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dgh\" (UniqueName: \"kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh\") pod \"network-check-target-vhzqm\" (UID: \"648080a2-3ab7-4a37-9369-4ee8309eb43d\") " pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:05:01.662286 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:01.662232    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 01:05:01.662286 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:01.662256    2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 01:05:01.662286 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:01.662267    2552 projected.go:196] Error preparing data for projected volume kube-api-access-s2dgh for pod openshift-network-diagnostics/network-check-target-vhzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:05:01.662406 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:01.662321    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh podName:648080a2-3ab7-4a37-9369-4ee8309eb43d nodeName:}" failed. No retries permitted until 2026-07-28 01:05:33.662305033 +0000 UTC m=+66.276613086 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-s2dgh" (UniqueName: "kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh") pod "network-check-target-vhzqm" (UID: "648080a2-3ab7-4a37-9369-4ee8309eb43d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 01:05:02.016299 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.016199    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:05:02.016299 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.016243    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:05:02.016527 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.016210    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:05:02.016527 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:02.016337    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vlsb4" podUID="7b3855d2-11ab-4755-b1a8-8c04ed3bab7e"
Jul 28 01:05:02.016527 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:02.016450    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:05:02.016675 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:02.016542    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vhzqm" podUID="648080a2-3ab7-4a37-9369-4ee8309eb43d"
Jul 28 01:05:02.160869 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.160839    2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeReady"
Jul 28 01:05:02.161034 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.160982    2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 01:05:02.204816 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.204762    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pwt7t"]
Jul 28 01:05:02.221933 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.221905    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dw9b8"]
Jul 28 01:05:02.222088 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.222015    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.224225 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.224203    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 01:05:02.224423 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.224280    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 01:05:02.224601 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.224578    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9pqrg\""
Jul 28 01:05:02.233906 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.233881    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dw9b8"]
Jul 28 01:05:02.234028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.233919    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pwt7t"]
Jul 28 01:05:02.234028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.234005    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dw9b8"
Jul 28 01:05:02.236304 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.236278    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 01:05:02.236432 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.236280    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 01:05:02.236432 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.236280    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 01:05:02.236432 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.236291    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w2j6n\""
Jul 28 01:05:02.367112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.367031    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14f3bcef-9b2a-4664-9f55-d39a858cd433-config-volume\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.367112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.367074    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnd9n\" (UniqueName: \"kubernetes.io/projected/b285aad5-dd32-4ce5-9dbd-7f6c66bade91-kube-api-access-tnd9n\") pod \"ingress-canary-dw9b8\" (UID: \"b285aad5-dd32-4ce5-9dbd-7f6c66bade91\") " pod="openshift-ingress-canary/ingress-canary-dw9b8"
Jul 28 01:05:02.367112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.367099    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b285aad5-dd32-4ce5-9dbd-7f6c66bade91-cert\") pod \"ingress-canary-dw9b8\" (UID: \"b285aad5-dd32-4ce5-9dbd-7f6c66bade91\") " pod="openshift-ingress-canary/ingress-canary-dw9b8"
Jul 28 01:05:02.367368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.367217    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f3bcef-9b2a-4664-9f55-d39a858cd433-tmp-dir\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.367368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.367289    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2tcf\" (UniqueName: \"kubernetes.io/projected/14f3bcef-9b2a-4664-9f55-d39a858cd433-kube-api-access-b2tcf\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.367368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.367330    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.376074 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.376043    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:02.438497 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.438419    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:02.467929 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.467893    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14f3bcef-9b2a-4664-9f55-d39a858cd433-config-volume\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.467929 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.467934    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnd9n\" (UniqueName: \"kubernetes.io/projected/b285aad5-dd32-4ce5-9dbd-7f6c66bade91-kube-api-access-tnd9n\") pod \"ingress-canary-dw9b8\" (UID: \"b285aad5-dd32-4ce5-9dbd-7f6c66bade91\") " pod="openshift-ingress-canary/ingress-canary-dw9b8"
Jul 28 01:05:02.468211 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.467958    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b285aad5-dd32-4ce5-9dbd-7f6c66bade91-cert\") pod \"ingress-canary-dw9b8\" (UID: \"b285aad5-dd32-4ce5-9dbd-7f6c66bade91\") " pod="openshift-ingress-canary/ingress-canary-dw9b8"
Jul 28 01:05:02.468211 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.467995    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f3bcef-9b2a-4664-9f55-d39a858cd433-tmp-dir\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.468211 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.468043    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tcf\" (UniqueName: \"kubernetes.io/projected/14f3bcef-9b2a-4664-9f55-d39a858cd433-kube-api-access-b2tcf\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.468211 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.468080    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.468439 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:02.468213    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:05:02.468439 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:02.468285    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls podName:14f3bcef-9b2a-4664-9f55-d39a858cd433 nodeName:}" failed. No retries permitted until 2026-07-28 01:05:02.968263731 +0000 UTC m=+35.582571786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls") pod "dns-default-pwt7t" (UID: "14f3bcef-9b2a-4664-9f55-d39a858cd433") : secret "dns-default-metrics-tls" not found
Jul 28 01:05:02.468439 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.468374    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14f3bcef-9b2a-4664-9f55-d39a858cd433-tmp-dir\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.468612 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.468541    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/14f3bcef-9b2a-4664-9f55-d39a858cd433-config-volume\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.478187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.478162    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2tcf\" (UniqueName: \"kubernetes.io/projected/14f3bcef-9b2a-4664-9f55-d39a858cd433-kube-api-access-b2tcf\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.478335 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.478318    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnd9n\" (UniqueName: \"kubernetes.io/projected/b285aad5-dd32-4ce5-9dbd-7f6c66bade91-kube-api-access-tnd9n\") pod \"ingress-canary-dw9b8\" (UID: \"b285aad5-dd32-4ce5-9dbd-7f6c66bade91\") " pod="openshift-ingress-canary/ingress-canary-dw9b8"
Jul 28 01:05:02.481397 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.481376    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b285aad5-dd32-4ce5-9dbd-7f6c66bade91-cert\") pod \"ingress-canary-dw9b8\" (UID: \"b285aad5-dd32-4ce5-9dbd-7f6c66bade91\") " pod="openshift-ingress-canary/ingress-canary-dw9b8"
Jul 28 01:05:02.544049 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.544010    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dw9b8"
Jul 28 01:05:02.972728 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:02.972693    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:02.973340 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:02.972870    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:05:02.973340 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:02.972937    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls podName:14f3bcef-9b2a-4664-9f55-d39a858cd433 nodeName:}" failed. No retries permitted until 2026-07-28 01:05:03.972922157 +0000 UTC m=+36.587230206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls") pod "dns-default-pwt7t" (UID: "14f3bcef-9b2a-4664-9f55-d39a858cd433") : secret "dns-default-metrics-tls" not found
Jul 28 01:05:03.025109 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:03.025071    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:03.078643 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:03.078609    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:03.672310 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:03.672107    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dw9b8"]
Jul 28 01:05:03.753556 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:05:03.753524    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb285aad5_dd32_4ce5_9dbd_7f6c66bade91.slice/crio-1597f7b4a61c7b839c369e49064aa186aa069f73920575cc1e5373c56ad0d053 WatchSource:0}: Error finding container 1597f7b4a61c7b839c369e49064aa186aa069f73920575cc1e5373c56ad0d053: Status 404 returned error can't find the container with id 1597f7b4a61c7b839c369e49064aa186aa069f73920575cc1e5373c56ad0d053
Jul 28 01:05:03.981175 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:03.981146    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:03.981560 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:03.981258    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:05:03.981560 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:03.981341    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls podName:14f3bcef-9b2a-4664-9f55-d39a858cd433 nodeName:}" failed. No retries permitted until 2026-07-28 01:05:05.981320883 +0000 UTC m=+38.595628934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls") pod "dns-default-pwt7t" (UID: "14f3bcef-9b2a-4664-9f55-d39a858cd433") : secret "dns-default-metrics-tls" not found
Jul 28 01:05:04.016190 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.016165    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:05:04.016318 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.016161    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:05:04.016318 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.016282    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:05:04.019800 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.019780    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qvhk6\""
Jul 28 01:05:04.019923 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.019799    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 01:05:04.019923 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.019838    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 01:05:04.019923 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.019869    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 01:05:04.019923 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.019841    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vxkxb\""
Jul 28 01:05:04.020090 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.019938    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 01:05:04.211648 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.211615    2552 generic.go:356] "Generic (PLEG): container finished" podID="46d16632-292e-409c-a90d-931eb85e6e88" containerID="5f7f6a65197a45d3f033ff326e425179d26ce08280d006fd08512bb6bd152745" exitCode=0
Jul 28 01:05:04.211818 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.211692    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8blwn" event={"ID":"46d16632-292e-409c-a90d-931eb85e6e88","Type":"ContainerDied","Data":"5f7f6a65197a45d3f033ff326e425179d26ce08280d006fd08512bb6bd152745"}
Jul 28 01:05:04.212840 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.212821    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dw9b8" event={"ID":"b285aad5-dd32-4ce5-9dbd-7f6c66bade91","Type":"ContainerStarted","Data":"1597f7b4a61c7b839c369e49064aa186aa069f73920575cc1e5373c56ad0d053"}
Jul 28 01:05:04.377222 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.377189    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:04.428839 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:04.428753    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:05.218013 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:05.217983    2552 generic.go:356] "Generic (PLEG): container finished" podID="46d16632-292e-409c-a90d-931eb85e6e88" containerID="19e28657201cbb0652debc3ac798826c2bced603f5a9fb44352b99af7b8a96df" exitCode=0
Jul 28 01:05:05.218405 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:05.218036    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8blwn" event={"ID":"46d16632-292e-409c-a90d-931eb85e6e88","Type":"ContainerDied","Data":"19e28657201cbb0652debc3ac798826c2bced603f5a9fb44352b99af7b8a96df"}
Jul 28 01:05:05.998507 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:05.998468    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:05.998668 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:05.998627    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:05:05.998707 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:05.998696    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls podName:14f3bcef-9b2a-4664-9f55-d39a858cd433 nodeName:}" failed. No retries permitted until 2026-07-28 01:05:09.998677746 +0000 UTC m=+42.612985796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls") pod "dns-default-pwt7t" (UID: "14f3bcef-9b2a-4664-9f55-d39a858cd433") : secret "dns-default-metrics-tls" not found
Jul 28 01:05:06.223715 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:06.223339    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8blwn" event={"ID":"46d16632-292e-409c-a90d-931eb85e6e88","Type":"ContainerStarted","Data":"3f030db6f2b75ac36b7d0944bf76403a3c8b2c99c7526741ea579ffeea8016d9"}
Jul 28 01:05:06.249288 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:06.249220    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8blwn" podStartSLOduration=9.525307626 podStartE2EDuration="39.249197659s" totalImagesPullingTime="29.723890033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:05:06.245579966 +0000 UTC m=+38.859888039" watchObservedRunningTime="2026-07-28 01:05:06.249197659 +0000 UTC m=+38.863505734"
Jul 28 01:05:06.366585 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:06.366555    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:06.419847 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:06.419807    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:07.227280 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:07.227243    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dw9b8" event={"ID":"b285aad5-dd32-4ce5-9dbd-7f6c66bade91","Type":"ContainerStarted","Data":"2a80d420fef799f3051a613043810b73613efb899db666cd2f1ab9cc2739b313"}
Jul 28 01:05:07.260188 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:07.260121    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dw9b8" podStartSLOduration=2.82574936 podStartE2EDuration="5.260103369s" totalImagesPullingTime="2.434354009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:05:07.259938255 +0000 UTC m=+39.874246327" watchObservedRunningTime="2026-07-28 01:05:07.260103369 +0000 UTC m=+39.874411441"
Jul 28 01:05:07.527790 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:07.527688    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:07.582893 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:07.582859    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:10.027807 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:10.027779    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:10.028290 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:10.027889    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:05:10.028290 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:10.027938    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls podName:14f3bcef-9b2a-4664-9f55-d39a858cd433 nodeName:}" failed. No retries permitted until 2026-07-28 01:05:18.027923598 +0000 UTC m=+50.642231648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls") pod "dns-default-pwt7t" (UID: "14f3bcef-9b2a-4664-9f55-d39a858cd433") : secret "dns-default-metrics-tls" not found
Jul 28 01:05:10.778531 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:10.778491    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:10.829745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:10.829707    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:18.077247 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:18.077211    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:18.077709 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:18.077370    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:05:18.077709 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:18.077457    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls podName:14f3bcef-9b2a-4664-9f55-d39a858cd433 nodeName:}" failed. No retries permitted until 2026-07-28 01:05:34.077437982 +0000 UTC m=+66.691746035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls") pod "dns-default-pwt7t" (UID: "14f3bcef-9b2a-4664-9f55-d39a858cd433") : secret "dns-default-metrics-tls" not found
Jul 28 01:05:26.012548 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:26.012507    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:26.112992 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:26.112960    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:28.210336 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:28.210307    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2999"
Jul 28 01:05:28.401213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:28.401177    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:28.460097 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:28.460049    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:33.589531 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.589479    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:05:33.590043 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.589567    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:05:33.592036 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.592018    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 01:05:33.592107 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.592042    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 01:05:33.600326 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:33.600301    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 01:05:33.600429 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:33.600379    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs podName:b55dc23e-8f3c-41ba-9d22-d3bd76112806 nodeName:}" failed. No retries permitted until 2026-07-28 01:06:37.600363553 +0000 UTC m=+130.214671603 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs") pod "network-metrics-daemon-wj5vw" (UID: "b55dc23e-8f3c-41ba-9d22-d3bd76112806") : secret "metrics-daemon-secret" not found
Jul 28 01:05:33.604082 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.604064    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b3855d2-11ab-4755-b1a8-8c04ed3bab7e-original-pull-secret\") pod \"global-pull-secret-syncer-vlsb4\" (UID: \"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e\") " pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:05:33.690102 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.690053    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dgh\" (UniqueName: \"kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh\") pod \"network-check-target-vhzqm\" (UID: \"648080a2-3ab7-4a37-9369-4ee8309eb43d\") " pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:05:33.692902 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.692880    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 01:05:33.702979 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.702957    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 01:05:33.713498 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.713465    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2dgh\" (UniqueName: \"kubernetes.io/projected/648080a2-3ab7-4a37-9369-4ee8309eb43d-kube-api-access-s2dgh\") pod \"network-check-target-vhzqm\" (UID: \"648080a2-3ab7-4a37-9369-4ee8309eb43d\") " pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:05:33.743738 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.743706    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vxkxb\""
Jul 28 01:05:33.751680 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.751655    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:05:33.751786 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.751681    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlsb4"
Jul 28 01:05:33.904854 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.904822    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vhzqm"]
Jul 28 01:05:33.908169 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:05:33.908142    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod648080a2_3ab7_4a37_9369_4ee8309eb43d.slice/crio-f2c72aac465ec79aa9b7c3219c093b6434baa01929e82c4cffdd0c17ac0d58b2 WatchSource:0}: Error finding container f2c72aac465ec79aa9b7c3219c093b6434baa01929e82c4cffdd0c17ac0d58b2: Status 404 returned error can't find the container with id f2c72aac465ec79aa9b7c3219c093b6434baa01929e82c4cffdd0c17ac0d58b2
Jul 28 01:05:33.919956 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:33.919931    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vlsb4"]
Jul 28 01:05:33.922792 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:05:33.922769    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b3855d2_11ab_4755_b1a8_8c04ed3bab7e.slice/crio-65a84a1636ca8378adc40897653d26ebbba7a7d4f596ce35ee70e82f220ad321 WatchSource:0}: Error finding container 65a84a1636ca8378adc40897653d26ebbba7a7d4f596ce35ee70e82f220ad321: Status 404 returned error can't find the container with id 65a84a1636ca8378adc40897653d26ebbba7a7d4f596ce35ee70e82f220ad321
Jul 28 01:05:34.093474 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:34.093434    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:05:34.093653 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:34.093556    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:05:34.093653 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:05:34.093618    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls podName:14f3bcef-9b2a-4664-9f55-d39a858cd433 nodeName:}" failed. No retries permitted until 2026-07-28 01:06:06.09360403 +0000 UTC m=+98.707912081 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls") pod "dns-default-pwt7t" (UID: "14f3bcef-9b2a-4664-9f55-d39a858cd433") : secret "dns-default-metrics-tls" not found
Jul 28 01:05:34.288450 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:34.288416    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vlsb4" event={"ID":"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e","Type":"ContainerStarted","Data":"65a84a1636ca8378adc40897653d26ebbba7a7d4f596ce35ee70e82f220ad321"}
Jul 28 01:05:34.289560 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:34.289529    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vhzqm" event={"ID":"648080a2-3ab7-4a37-9369-4ee8309eb43d","Type":"ContainerStarted","Data":"f2c72aac465ec79aa9b7c3219c093b6434baa01929e82c4cffdd0c17ac0d58b2"}
Jul 28 01:05:38.304434 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:38.304405    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vhzqm" event={"ID":"648080a2-3ab7-4a37-9369-4ee8309eb43d","Type":"ContainerStarted","Data":"976e8565db32491832e80cf892610802a8499d9ce216d4e42219059e37602a43"}
Jul 28 01:05:38.304772 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:38.304540    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:05:38.317994 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:38.317945    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vhzqm" podStartSLOduration=67.005840908 podStartE2EDuration="1m11.317929569s" totalImagesPullingTime="4.312088661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:05:38.317232114 +0000 UTC m=+70.931540186" watchObservedRunningTime="2026-07-28 01:05:38.317929569 +0000 UTC m=+70.932237620"
Jul 28 01:05:39.311303 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:39.311260    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vlsb4" event={"ID":"7b3855d2-11ab-4755-b1a8-8c04ed3bab7e","Type":"ContainerStarted","Data":"8e17ee6de01bdbf2669903621fa350ff844bd6e3b4da0dfed152dfcd4e77cadf"}
Jul 28 01:05:39.325301 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:39.325254    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vlsb4" podStartSLOduration=67.023821533 podStartE2EDuration="1m11.325237558s" totalImagesPullingTime="4.301416025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:05:39.324543944 +0000 UTC m=+71.938852015" watchObservedRunningTime="2026-07-28 01:05:39.325237558 +0000 UTC m=+71.939545629"
Jul 28 01:05:40.601312 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:40.601278    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:05:43.197382 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.197349    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"]
Jul 28 01:05:43.199530 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.199515    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.201777 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.201754    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 28 01:05:43.201998 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.201974    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 01:05:43.201998 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.201990    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 28 01:05:43.202248 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.202234    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 28 01:05:43.202801 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.202786    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 01:05:43.202843 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.202813    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 28 01:05:43.203054 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.203037    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 01:05:43.212111 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.212091    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"]
Jul 28 01:05:43.255228 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.255188    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f23f20f-5203-4927-80e9-052af83d21bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.255228 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.255229    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-ca\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.255434 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.255262    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.255434 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.255312    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jbmb\" (UniqueName: \"kubernetes.io/projected/5f23f20f-5203-4927-80e9-052af83d21bd-kube-api-access-7jbmb\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.255434 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.255423    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-hub\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.255530 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.255488    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.355937 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.355901    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.355937 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.355939    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f23f20f-5203-4927-80e9-052af83d21bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.356110 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.355960    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-ca\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.356110 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.356082    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.356210 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.356113    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jbmb\" (UniqueName: \"kubernetes.io/projected/5f23f20f-5203-4927-80e9-052af83d21bd-kube-api-access-7jbmb\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.356210 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.356186    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-hub\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.356890 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.356747    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f23f20f-5203-4927-80e9-052af83d21bd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.358717 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.358691    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.358834 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.358731    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.358834 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.358749    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-ca\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.358834 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.358760    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5f23f20f-5203-4927-80e9-052af83d21bd-hub\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.364329 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.364304    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jbmb\" (UniqueName: \"kubernetes.io/projected/5f23f20f-5203-4927-80e9-052af83d21bd-kube-api-access-7jbmb\") pod \"cluster-proxy-proxy-agent-5ff74cff7f-6s9t9\" (UID: \"5f23f20f-5203-4927-80e9-052af83d21bd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.520560 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.520458    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:05:43.643861 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:43.643824    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"]
Jul 28 01:05:43.647410 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:05:43.647387    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f23f20f_5203_4927_80e9_052af83d21bd.slice/crio-43e87e3ea31a710606fdc64a1c9bc327138abc20b32bf2fe8d1bb9f335025360 WatchSource:0}: Error finding container 43e87e3ea31a710606fdc64a1c9bc327138abc20b32bf2fe8d1bb9f335025360: Status 404 returned error can't find the container with id 43e87e3ea31a710606fdc64a1c9bc327138abc20b32bf2fe8d1bb9f335025360
Jul 28 01:05:44.325028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:44.324985    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" event={"ID":"5f23f20f-5203-4927-80e9-052af83d21bd","Type":"ContainerStarted","Data":"43e87e3ea31a710606fdc64a1c9bc327138abc20b32bf2fe8d1bb9f335025360"}
Jul 28 01:05:48.339071 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:48.339034    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" event={"ID":"5f23f20f-5203-4927-80e9-052af83d21bd","Type":"ContainerStarted","Data":"4be311ab7893357aba98a590a78c0dc8b186e72c713eeee2f0a4eb1f4824ce8d"}
Jul 28 01:05:48.339452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:48.339087    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" event={"ID":"5f23f20f-5203-4927-80e9-052af83d21bd","Type":"ContainerStarted","Data":"79826e618a52367f0014c7832092ba595c278e6822932b08946fa14a4b7b7812"}
Jul 28 01:05:48.339452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:48.339105    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" event={"ID":"5f23f20f-5203-4927-80e9-052af83d21bd","Type":"ContainerStarted","Data":"4933952bed4cc380789046275b0fb9da8b85e62d90326890274341b00bbd8797"}
Jul 28 01:05:48.357183 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:05:48.357112    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" podStartSLOduration=0.827811472 podStartE2EDuration="5.357096129s" totalImagesPullingTime="4.529284657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:05:48.355403348 +0000 UTC m=+80.969711456" watchObservedRunningTime="2026-07-28 01:05:48.357096129 +0000 UTC m=+80.971404201"
Jul 28 01:06:06.115585 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:06:06.115546    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:06:06.116002 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:06:06.115669    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:06:06.116002 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:06:06.115729    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls podName:14f3bcef-9b2a-4664-9f55-d39a858cd433 nodeName:}" failed. No retries permitted until 2026-07-28 01:07:10.115711795 +0000 UTC m=+162.730019846 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls") pod "dns-default-pwt7t" (UID: "14f3bcef-9b2a-4664-9f55-d39a858cd433") : secret "dns-default-metrics-tls" not found
Jul 28 01:06:09.314000 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:06:09.313969    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vhzqm"
Jul 28 01:06:37.629344 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:06:37.629293    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:06:37.629842 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:06:37.629446    2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 01:06:37.629842 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:06:37.629524    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs podName:b55dc23e-8f3c-41ba-9d22-d3bd76112806 nodeName:}" failed. No retries permitted until 2026-07-28 01:08:39.629507297 +0000 UTC m=+252.243815347 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs") pod "network-metrics-daemon-wj5vw" (UID: "b55dc23e-8f3c-41ba-9d22-d3bd76112806") : secret "metrics-daemon-secret" not found
Jul 28 01:07:05.233194 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:07:05.233146    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pwt7t" podUID="14f3bcef-9b2a-4664-9f55-d39a858cd433"
Jul 28 01:07:05.565451 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:07:05.565372    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:07:07.047044 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:07:07.047003    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wj5vw" podUID="b55dc23e-8f3c-41ba-9d22-d3bd76112806"
Jul 28 01:07:10.160931 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:07:10.160885    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:07:10.161385 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:07:10.161035    2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 01:07:10.161385 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:07:10.161109    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls podName:14f3bcef-9b2a-4664-9f55-d39a858cd433 nodeName:}" failed. No retries permitted until 2026-07-28 01:09:12.161091411 +0000 UTC m=+284.775399462 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls") pod "dns-default-pwt7t" (UID: "14f3bcef-9b2a-4664-9f55-d39a858cd433") : secret "dns-default-metrics-tls" not found
Jul 28 01:07:18.017379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:07:18.017280    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:07:43.864326 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:07:43.864283    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:10.264958 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.264925    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"]
Jul 28 01:08:10.266827 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.266812    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:10.269355 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.269333    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 01:08:10.269477 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.269375    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zmwr4\""
Jul 28 01:08:10.269477 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.269424    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 01:08:10.278089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.278068    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"]
Jul 28 01:08:10.301843 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.301813    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:10.350364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.350332    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:10.375447 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.375425    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:10.375555 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.375462    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:10.475933 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.475897    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:10.476053 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.475993    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:10.476097 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:10.476048    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:08:10.476473 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:10.476450    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert podName:9f762ba3-b1ff-44f4-946f-c7cc94e9f70b nodeName:}" failed. No retries permitted until 2026-07-28 01:08:10.97609655 +0000 UTC m=+223.590404614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mmzvs" (UID: "9f762ba3-b1ff-44f4-946f-c7cc94e9f70b") : secret "networking-console-plugin-cert" not found
Jul 28 01:08:10.479636 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.477045    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:10.980411 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:10.980359    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:10.980611 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:10.980512    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:08:10.980611 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:10.980588    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert podName:9f762ba3-b1ff-44f4-946f-c7cc94e9f70b nodeName:}" failed. No retries permitted until 2026-07-28 01:08:11.98057197 +0000 UTC m=+224.594880020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mmzvs" (UID: "9f762ba3-b1ff-44f4-946f-c7cc94e9f70b") : secret "networking-console-plugin-cert" not found
Jul 28 01:08:11.988248 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:11.988193    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:11.988651 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:11.988351    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:08:11.988651 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:11.988424    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert podName:9f762ba3-b1ff-44f4-946f-c7cc94e9f70b nodeName:}" failed. No retries permitted until 2026-07-28 01:08:13.988408002 +0000 UTC m=+226.602716052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mmzvs" (UID: "9f762ba3-b1ff-44f4-946f-c7cc94e9f70b") : secret "networking-console-plugin-cert" not found
Jul 28 01:08:12.435849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:12.435817    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:12.486581 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:12.486555    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:13.999921 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:13.999886    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:14.000369 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:14.000041    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:08:14.000369 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:14.000112    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert podName:9f762ba3-b1ff-44f4-946f-c7cc94e9f70b nodeName:}" failed. No retries permitted until 2026-07-28 01:08:18.000095682 +0000 UTC m=+230.614403752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mmzvs" (UID: "9f762ba3-b1ff-44f4-946f-c7cc94e9f70b") : secret "networking-console-plugin-cert" not found
Jul 28 01:08:14.436272 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.436242    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:14.468635 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.468591    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp"]
Jul 28 01:08:14.470708 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.470688    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp"
Jul 28 01:08:14.472978 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.472950    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 28 01:08:14.473089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.472997    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 28 01:08:14.473089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.473073    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bzvn9\""
Jul 28 01:08:14.480286 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.480266    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp"]
Jul 28 01:08:14.531989 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.531964    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:14.546664 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.546631    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n4ksc"]
Jul 28 01:08:14.548831 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.548811    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.550875 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.550850    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 01:08:14.550973 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.550952    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 01:08:14.551299 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.551285    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7gpmd\""
Jul 28 01:08:14.551505 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.551491    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 01:08:14.551599 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.551580    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 01:08:14.559060 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.559038    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n4ksc"]
Jul 28 01:08:14.595225 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.595187    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:14.605065 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.605036    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg8m7\" (UniqueName: \"kubernetes.io/projected/5e00b90f-64a6-471a-b777-099da6e039d5-kube-api-access-fg8m7\") pod \"migrator-6865c9967-9gljp\" (UID: \"5e00b90f-64a6-471a-b777-099da6e039d5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp"
Jul 28 01:08:14.705648 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.705573    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/028634a0-3ead-4640-b4d8-fb8024c6ad8f-data-volume\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.705648 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.705609    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg8m7\" (UniqueName: \"kubernetes.io/projected/5e00b90f-64a6-471a-b777-099da6e039d5-kube-api-access-fg8m7\") pod \"migrator-6865c9967-9gljp\" (UID: \"5e00b90f-64a6-471a-b777-099da6e039d5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp"
Jul 28 01:08:14.705648 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.705634    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.705893 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.705660    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9kpq\" (UniqueName: \"kubernetes.io/projected/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-api-access-n9kpq\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.705893 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.705782    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/028634a0-3ead-4640-b4d8-fb8024c6ad8f-crio-socket\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.705893 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.705817    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.713085 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.713057    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg8m7\" (UniqueName: \"kubernetes.io/projected/5e00b90f-64a6-471a-b777-099da6e039d5-kube-api-access-fg8m7\") pod \"migrator-6865c9967-9gljp\" (UID: \"5e00b90f-64a6-471a-b777-099da6e039d5\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp"
Jul 28 01:08:14.779264 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.779217    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp"
Jul 28 01:08:14.807145 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.807102    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/028634a0-3ead-4640-b4d8-fb8024c6ad8f-data-volume\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.807316 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.807159    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.807316 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.807186    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9kpq\" (UniqueName: \"kubernetes.io/projected/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-api-access-n9kpq\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.807316 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.807273    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/028634a0-3ead-4640-b4d8-fb8024c6ad8f-crio-socket\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.807316 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:14.807280    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:08:14.807481 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.807342    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/028634a0-3ead-4640-b4d8-fb8024c6ad8f-crio-socket\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.807481 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:14.807363    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm podName:028634a0-3ead-4640-b4d8-fb8024c6ad8f nodeName:}" failed. No retries permitted until 2026-07-28 01:08:15.30734185 +0000 UTC m=+227.921649916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n4ksc" (UID: "028634a0-3ead-4640-b4d8-fb8024c6ad8f") : configmap "kube-rbac-proxy" not found
Jul 28 01:08:14.807481 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.807429    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.807481 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.807446    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/028634a0-3ead-4640-b4d8-fb8024c6ad8f-data-volume\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.807614 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:14.807528    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:08:14.807614 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:14.807601    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls podName:028634a0-3ead-4640-b4d8-fb8024c6ad8f nodeName:}" failed. No retries permitted until 2026-07-28 01:08:15.307585097 +0000 UTC m=+227.921893149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n4ksc" (UID: "028634a0-3ead-4640-b4d8-fb8024c6ad8f") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:08:14.815564 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.815520    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9kpq\" (UniqueName: \"kubernetes.io/projected/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-api-access-n9kpq\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:14.833792 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.833748    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:14.883881 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.883849    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:14.903239 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:14.903210    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp"]
Jul 28 01:08:14.906225 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:08:14.906195    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e00b90f_64a6_471a_b777_099da6e039d5.slice/crio-1dde216f05a34df3771c55add76dc5a44277139e87dcc9fbc92a663c37e1b2d7 WatchSource:0}: Error finding container 1dde216f05a34df3771c55add76dc5a44277139e87dcc9fbc92a663c37e1b2d7: Status 404 returned error can't find the container with id 1dde216f05a34df3771c55add76dc5a44277139e87dcc9fbc92a663c37e1b2d7
Jul 28 01:08:15.105350 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:15.105270    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:15.194607 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:15.194577    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:15.310441 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:15.310406    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:15.310588 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:15.310457    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:15.310588 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:15.310534    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:08:15.310588 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:15.310560    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:08:15.310701 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:15.310608    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm podName:028634a0-3ead-4640-b4d8-fb8024c6ad8f nodeName:}" failed. No retries permitted until 2026-07-28 01:08:16.310588874 +0000 UTC m=+228.924896928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n4ksc" (UID: "028634a0-3ead-4640-b4d8-fb8024c6ad8f") : configmap "kube-rbac-proxy" not found
Jul 28 01:08:15.310701 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:15.310621    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls podName:028634a0-3ead-4640-b4d8-fb8024c6ad8f nodeName:}" failed. No retries permitted until 2026-07-28 01:08:16.310615738 +0000 UTC m=+228.924923787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n4ksc" (UID: "028634a0-3ead-4640-b4d8-fb8024c6ad8f") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:08:15.764161 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:15.764111    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp" event={"ID":"5e00b90f-64a6-471a-b777-099da6e039d5","Type":"ContainerStarted","Data":"1dde216f05a34df3771c55add76dc5a44277139e87dcc9fbc92a663c37e1b2d7"}
Jul 28 01:08:16.318871 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:16.318831    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:16.319258 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:16.318906    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:16.319258 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:16.318971    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:08:16.319258 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:16.319003    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:08:16.319258 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:16.319045    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm podName:028634a0-3ead-4640-b4d8-fb8024c6ad8f nodeName:}" failed. No retries permitted until 2026-07-28 01:08:18.319026851 +0000 UTC m=+230.933334900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n4ksc" (UID: "028634a0-3ead-4640-b4d8-fb8024c6ad8f") : configmap "kube-rbac-proxy" not found
Jul 28 01:08:16.319258 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:16.319059    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls podName:028634a0-3ead-4640-b4d8-fb8024c6ad8f nodeName:}" failed. No retries permitted until 2026-07-28 01:08:18.319053085 +0000 UTC m=+230.933361134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n4ksc" (UID: "028634a0-3ead-4640-b4d8-fb8024c6ad8f") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:08:16.735308 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:16.735276    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:16.767985 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:16.767946    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp" event={"ID":"5e00b90f-64a6-471a-b777-099da6e039d5","Type":"ContainerStarted","Data":"cbb5400414c973466cdab4310cb2e6c6581d78b462ea7cc2a9d360a1864b25b0"}
Jul 28 01:08:16.768173 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:16.768008    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp" event={"ID":"5e00b90f-64a6-471a-b777-099da6e039d5","Type":"ContainerStarted","Data":"94b08b306afc2804d6a75b2c75d55967a4ab8ac32ccceb522ba0107348c589fc"}
Jul 28 01:08:16.782429 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:16.782387    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9gljp" podStartSLOduration=1.557493434 podStartE2EDuration="2.782371652s" totalImagesPullingTime="1.224878218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:08:16.781147806 +0000 UTC m=+229.395455868" watchObservedRunningTime="2026-07-28 01:08:16.782371652 +0000 UTC m=+229.396679723"
Jul 28 01:08:16.785640 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:16.785603    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:16.886784 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:16.886752    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:16.987695 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:16.987612    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:17.328899 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:17.328828    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jr95w_49fb854d-b686-4dc6-acc0-0e3c17a1fae1/dns-node-resolver/0.log"
Jul 28 01:08:17.628781 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:17.628682    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:17.962330 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:17.962300    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:18.033579 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:18.033539    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:18.033717 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:18.033662    2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 28 01:08:18.033772 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:18.033718    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert podName:9f762ba3-b1ff-44f4-946f-c7cc94e9f70b nodeName:}" failed. No retries permitted until 2026-07-28 01:08:26.033704913 +0000 UTC m=+238.648012963 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-mmzvs" (UID: "9f762ba3-b1ff-44f4-946f-c7cc94e9f70b") : secret "networking-console-plugin-cert" not found
Jul 28 01:08:18.235804 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:18.235724    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:18.329584 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:18.329550    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fsnhz_b78c0dba-b7d9-4361-95f2-c0990578e1e6/node-ca/0.log"
Jul 28 01:08:18.330055 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:18.329811    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:18.335182 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:18.335157    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:18.335296 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:18.335258    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:18.335296 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:18.335268    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:08:18.335426 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:18.335322    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm podName:028634a0-3ead-4640-b4d8-fb8024c6ad8f nodeName:}" failed. No retries permitted until 2026-07-28 01:08:22.335303898 +0000 UTC m=+234.949611948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n4ksc" (UID: "028634a0-3ead-4640-b4d8-fb8024c6ad8f") : configmap "kube-rbac-proxy" not found
Jul 28 01:08:18.335426 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:18.335386    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:08:18.335522 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:18.335446    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls podName:028634a0-3ead-4640-b4d8-fb8024c6ad8f nodeName:}" failed. No retries permitted until 2026-07-28 01:08:22.335430033 +0000 UTC m=+234.949738085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n4ksc" (UID: "028634a0-3ead-4640-b4d8-fb8024c6ad8f") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:08:18.431350 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:18.431314    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:18.534644 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:18.534558    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:18.651410 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:18.651373    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:18.928931 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:18.928906    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dw9b8_b285aad5-dd32-4ce5-9dbd-7f6c66bade91/serve-healthcheck-canary/0.log"
Jul 28 01:08:19.453405 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:19.453380    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:19.530088 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:19.530062    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-9gljp_5e00b90f-64a6-471a-b777-099da6e039d5/migrator/0.log"
Jul 28 01:08:19.729120 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:19.729055    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-9gljp_5e00b90f-64a6-471a-b777-099da6e039d5/graceful-termination/0.log"
Jul 28 01:08:20.060179 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:20.060072    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:20.207968 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:20.207895    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:20.311093 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:20.311016    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:20.657395 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:20.657367    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:20.855144 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:20.855111    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:21.061399 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:21.061324    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:21.854381 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:21.854337    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:21.903475 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:21.903446    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:22.058447 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:22.058419    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:22.265636 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:22.265610    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:22.370375 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:22.370327    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:22.370564 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:22.370421    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:22.370564 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:22.370448    2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 01:08:22.370564 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:22.370507    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm podName:028634a0-3ead-4640-b4d8-fb8024c6ad8f nodeName:}" failed. No retries permitted until 2026-07-28 01:08:30.370491849 +0000 UTC m=+242.984799899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n4ksc" (UID: "028634a0-3ead-4640-b4d8-fb8024c6ad8f") : configmap "kube-rbac-proxy" not found
Jul 28 01:08:22.370564 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:22.370533    2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 01:08:22.370698 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:22.370576    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls podName:028634a0-3ead-4640-b4d8-fb8024c6ad8f nodeName:}" failed. No retries permitted until 2026-07-28 01:08:30.370565189 +0000 UTC m=+242.984873239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n4ksc" (UID: "028634a0-3ead-4640-b4d8-fb8024c6ad8f") : secret "insights-runtime-extractor-tls" not found
Jul 28 01:08:22.662291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:22.662261    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:22.851612 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:22.851579    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:23.454002 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:23.453962    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:23.655095 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:23.655065    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:24.250249 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:24.250209    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:24.443979 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:24.443938    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:24.649841 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:24.649794    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:25.056075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:25.055973    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:25.456258 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:25.456212    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:25.651553 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:25.651522    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:26.062362 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:26.062326    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:26.101089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:26.101059    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:26.103550 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:26.103527    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f762ba3-b1ff-44f4-946f-c7cc94e9f70b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-mmzvs\" (UID: \"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:26.175654 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:26.175613    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"
Jul 28 01:08:26.303692 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:26.303658    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs"]
Jul 28 01:08:26.306422 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:08:26.306396    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f762ba3_b1ff_44f4_946f_c7cc94e9f70b.slice/crio-b74238dc80b92cba47dbfbe4921f057ef38556b74fdc32fdee75450e59af7335 WatchSource:0}: Error finding container b74238dc80b92cba47dbfbe4921f057ef38556b74fdc32fdee75450e59af7335: Status 404 returned error can't find the container with id b74238dc80b92cba47dbfbe4921f057ef38556b74fdc32fdee75450e59af7335
Jul 28 01:08:26.651950 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:26.651921    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:26.799604 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:26.799565    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs" event={"ID":"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b","Type":"ContainerStarted","Data":"b74238dc80b92cba47dbfbe4921f057ef38556b74fdc32fdee75450e59af7335"}
Jul 28 01:08:27.057434 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:27.057350    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:27.250007 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:27.249973    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:27.648321 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:27.648277    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:27.697442 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:27.697409    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:27.805888 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:27.805859    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs" event={"ID":"9f762ba3-b1ff-44f4-946f-c7cc94e9f70b","Type":"ContainerStarted","Data":"8e629d8a51b3a6aac238eda6488ac487663d94d9edb8513db60abd017d74e987"}
Jul 28 01:08:27.822882 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:27.822829    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-mmzvs" podStartSLOduration=16.405868923 podStartE2EDuration="17.822813585s" totalImagesPullingTime="1.416944662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:08:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:08:27.822331394 +0000 UTC m=+240.436639478" watchObservedRunningTime="2026-07-28 01:08:27.822813585 +0000 UTC m=+240.437121657"
Jul 28 01:08:28.054092 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:28.054016    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:28.325409 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:28.325324    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:28.637021 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:28.636993    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:28.737663 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:28.737627    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:28.837753 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:28.837725    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:28.895392 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:28.895312    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:29.054185 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:29.054156    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:30.430451 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:30.430409    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:30.430835 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:30.430464    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:30.430933 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:30.430917    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/028634a0-3ead-4640-b4d8-fb8024c6ad8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:30.432986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:30.432950    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/028634a0-3ead-4640-b4d8-fb8024c6ad8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4ksc\" (UID: \"028634a0-3ead-4640-b4d8-fb8024c6ad8f\") " pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:30.460221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:30.460187    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7gpmd\""
Jul 28 01:08:30.468201 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:30.468172    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n4ksc"
Jul 28 01:08:30.596332 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:30.596300    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n4ksc"]
Jul 28 01:08:30.599182 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:08:30.599152    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028634a0_3ead_4640_b4d8_fb8024c6ad8f.slice/crio-89a214780e662ceae3af6966c3ac2c7ed37d522809402a3987f8cd74b3fdee3f WatchSource:0}: Error finding container 89a214780e662ceae3af6966c3ac2c7ed37d522809402a3987f8cd74b3fdee3f: Status 404 returned error can't find the container with id 89a214780e662ceae3af6966c3ac2c7ed37d522809402a3987f8cd74b3fdee3f
Jul 28 01:08:30.816571 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:30.816476    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n4ksc" event={"ID":"028634a0-3ead-4640-b4d8-fb8024c6ad8f","Type":"ContainerStarted","Data":"89a214780e662ceae3af6966c3ac2c7ed37d522809402a3987f8cd74b3fdee3f"}
Jul 28 01:08:33.522337 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:33.522291    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" podUID="5f23f20f-5203-4927-80e9-052af83d21bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 01:08:35.834301 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:35.834202    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n4ksc" event={"ID":"028634a0-3ead-4640-b4d8-fb8024c6ad8f","Type":"ContainerStarted","Data":"951374ebc8123604282fb70477a64adbc5c5306050b8e3e192af8f18af673793"}
Jul 28 01:08:35.995264 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:35.995225    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:36.095872 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:36.095769    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:36.196477 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:36.196437    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:36.281021 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:36.280989    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:36.338457 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:36.338422    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:36.503223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:36.503192    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:36.862924 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:36.862841    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:36.963339 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:36.963304    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:37.678582 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:37.678550    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:37.877346 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:37.877309    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:37.927225 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:37.927195    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:38.078704 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:38.078632    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:38.180182 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:38.180151    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:38.338213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:38.338101    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:39.691150 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.691102    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:08:39.693994 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.693971    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b55dc23e-8f3c-41ba-9d22-d3bd76112806-metrics-certs\") pod \"network-metrics-daemon-wj5vw\" (UID: \"b55dc23e-8f3c-41ba-9d22-d3bd76112806\") " pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:08:39.810708 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.810674    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b57d68984-5t4kr"]
Jul 28 01:08:39.813831 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.813808    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.816513 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.816456    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bzh4w\""
Jul 28 01:08:39.816513 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.816511    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 01:08:39.816692 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.816458    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 01:08:39.816692 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.816458    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 01:08:39.821868 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.821846    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 01:08:39.829047 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.829026    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b57d68984-5t4kr"]
Jul 28 01:08:39.842941 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.842901    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:39.849698 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.849674    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n4ksc" event={"ID":"028634a0-3ead-4640-b4d8-fb8024c6ad8f","Type":"ContainerStarted","Data":"965bf5f67a0f3b62634e33e76c8e13514bccf6544a623f676301a5844fdb7f00"}
Jul 28 01:08:39.892739 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.892700    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17539a90-1dd8-4e74-a3bc-09dbfcd42049-registry-tls\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.892739 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.892739    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17539a90-1dd8-4e74-a3bc-09dbfcd42049-trusted-ca\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.892987 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.892780    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17539a90-1dd8-4e74-a3bc-09dbfcd42049-registry-certificates\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.892987 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.892837    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17539a90-1dd8-4e74-a3bc-09dbfcd42049-ca-trust-extracted\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.892987 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.892873    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cz2b\" (UniqueName: \"kubernetes.io/projected/17539a90-1dd8-4e74-a3bc-09dbfcd42049-kube-api-access-4cz2b\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.892987 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.892905    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17539a90-1dd8-4e74-a3bc-09dbfcd42049-bound-sa-token\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.892987 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.892968    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17539a90-1dd8-4e74-a3bc-09dbfcd42049-image-registry-private-configuration\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.893222 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.893001    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17539a90-1dd8-4e74-a3bc-09dbfcd42049-installation-pull-secrets\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.921112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.921079    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qvhk6\""
Jul 28 01:08:39.929569 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.929532    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wj5vw"
Jul 28 01:08:39.993658 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.993628    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17539a90-1dd8-4e74-a3bc-09dbfcd42049-registry-tls\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.993795 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.993676    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17539a90-1dd8-4e74-a3bc-09dbfcd42049-trusted-ca\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.993795 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.993710    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17539a90-1dd8-4e74-a3bc-09dbfcd42049-registry-certificates\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.993795 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.993755    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17539a90-1dd8-4e74-a3bc-09dbfcd42049-ca-trust-extracted\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.993795 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.993790    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cz2b\" (UniqueName: \"kubernetes.io/projected/17539a90-1dd8-4e74-a3bc-09dbfcd42049-kube-api-access-4cz2b\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.994010 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.993825    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17539a90-1dd8-4e74-a3bc-09dbfcd42049-bound-sa-token\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.994010 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.993857    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17539a90-1dd8-4e74-a3bc-09dbfcd42049-image-registry-private-configuration\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.994010 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.993895    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17539a90-1dd8-4e74-a3bc-09dbfcd42049-installation-pull-secrets\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.995117 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.994873    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/17539a90-1dd8-4e74-a3bc-09dbfcd42049-ca-trust-extracted\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.996223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.995954    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/17539a90-1dd8-4e74-a3bc-09dbfcd42049-registry-certificates\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.996223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.996099    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/17539a90-1dd8-4e74-a3bc-09dbfcd42049-trusted-ca\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.998054 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.998012    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/17539a90-1dd8-4e74-a3bc-09dbfcd42049-installation-pull-secrets\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.998190 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.998145    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/17539a90-1dd8-4e74-a3bc-09dbfcd42049-registry-tls\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:39.999423 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:39.999337    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/17539a90-1dd8-4e74-a3bc-09dbfcd42049-image-registry-private-configuration\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:40.018665 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:40.018626    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/17539a90-1dd8-4e74-a3bc-09dbfcd42049-bound-sa-token\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:40.020050 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:40.019029    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cz2b\" (UniqueName: \"kubernetes.io/projected/17539a90-1dd8-4e74-a3bc-09dbfcd42049-kube-api-access-4cz2b\") pod \"image-registry-6b57d68984-5t4kr\" (UID: \"17539a90-1dd8-4e74-a3bc-09dbfcd42049\") " pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:40.082988 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:40.082954    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wj5vw"]
Jul 28 01:08:40.086153 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:08:40.086082    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb55dc23e_8f3c_41ba_9d22_d3bd76112806.slice/crio-a2303b14f87308d9eba85c45ad6f25f37bd19b059038d8057db4b3b5fb192645 WatchSource:0}: Error finding container a2303b14f87308d9eba85c45ad6f25f37bd19b059038d8057db4b3b5fb192645: Status 404 returned error can't find the container with id a2303b14f87308d9eba85c45ad6f25f37bd19b059038d8057db4b3b5fb192645
Jul 28 01:08:40.125188 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:40.125154    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:40.278572 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:40.278481    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b57d68984-5t4kr"]
Jul 28 01:08:40.281666 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:08:40.281640    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17539a90_1dd8_4e74_a3bc_09dbfcd42049.slice/crio-f650b3c45e447d83304ef6e3b0452e46a39b6d5ffa700ce55c505fcacaeba1ca WatchSource:0}: Error finding container f650b3c45e447d83304ef6e3b0452e46a39b6d5ffa700ce55c505fcacaeba1ca: Status 404 returned error can't find the container with id f650b3c45e447d83304ef6e3b0452e46a39b6d5ffa700ce55c505fcacaeba1ca
Jul 28 01:08:40.856732 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:40.856633    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" event={"ID":"17539a90-1dd8-4e74-a3bc-09dbfcd42049","Type":"ContainerStarted","Data":"7b3cd4a03c146633c90bf07647677d08677479990b39a713a3477b3a1bd99fd1"}
Jul 28 01:08:40.856732 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:40.856696    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" event={"ID":"17539a90-1dd8-4e74-a3bc-09dbfcd42049","Type":"ContainerStarted","Data":"f650b3c45e447d83304ef6e3b0452e46a39b6d5ffa700ce55c505fcacaeba1ca"}
Jul 28 01:08:40.857311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:40.857078    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:08:40.858462 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:40.858395    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj5vw" event={"ID":"b55dc23e-8f3c-41ba-9d22-d3bd76112806","Type":"ContainerStarted","Data":"a2303b14f87308d9eba85c45ad6f25f37bd19b059038d8057db4b3b5fb192645"}
Jul 28 01:08:40.876447 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:40.875519    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" podStartSLOduration=1.87549829 podStartE2EDuration="1.87549829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:08:40.874593248 +0000 UTC m=+253.488901326" watchObservedRunningTime="2026-07-28 01:08:40.87549829 +0000 UTC m=+253.489806361"
Jul 28 01:08:41.273946 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:41.273911    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:42.866770 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:42.866737    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj5vw" event={"ID":"b55dc23e-8f3c-41ba-9d22-d3bd76112806","Type":"ContainerStarted","Data":"9938681115ba93dcc71499e601a5b566228c79456ed8856e7da20d5d5209065f"}
Jul 28 01:08:42.867171 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:42.866801    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wj5vw" event={"ID":"b55dc23e-8f3c-41ba-9d22-d3bd76112806","Type":"ContainerStarted","Data":"805c346254f0c706d2242ecec0f57d79bbbd13eea56da27ac07c1a51a27f0940"}
Jul 28 01:08:42.869108 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:42.869085    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n4ksc" event={"ID":"028634a0-3ead-4640-b4d8-fb8024c6ad8f","Type":"ContainerStarted","Data":"8636ccf816feee14ce6606095ef7f3904813677bffac310f28164bf924959d4c"}
Jul 28 01:08:42.881874 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:42.881831    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wj5vw" podStartSLOduration=253.909973096 podStartE2EDuration="4m14.881817681s" totalImagesPullingTime="971.844585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:08:42.880365904 +0000 UTC m=+255.494673967" watchObservedRunningTime="2026-07-28 01:08:42.881817681 +0000 UTC m=+255.496125753"
Jul 28 01:08:42.898245 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:42.898203    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n4ksc" podStartSLOduration=16.836905412 podStartE2EDuration="28.89818958s" totalImagesPullingTime="12.061284168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:08:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:08:42.896846981 +0000 UTC m=+255.511155052" watchObservedRunningTime="2026-07-28 01:08:42.89818958 +0000 UTC m=+255.512497654"
Jul 28 01:08:42.974060 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:42.973993    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:43.032973 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:43.032947    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:43.086028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:43.086001    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:43.521996 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:43.521960    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" podUID="5f23f20f-5203-4927-80e9-052af83d21bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 01:08:43.819430 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:43.819357    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:43.887178 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:43.887151    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:43.940996 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:43.940968    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:46.072717 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:46.072682    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:47.944390 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:47.944323    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:48.307201 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:48.307111    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:51.690039 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:51.690010    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:51.790592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:51.790564    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:52.994977 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:52.994945    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:53.020804 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.020748    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2tnc6"]
Jul 28 01:08:53.025638 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.025019    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.028042 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.028021    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 01:08:53.028194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.028170    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 01:08:53.029070 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.029053    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pq5bc\""
Jul 28 01:08:53.029184 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.029105    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 01:08:53.029184 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.029124    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 01:08:53.029184 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.029150    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 01:08:53.029184 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.029152    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 01:08:53.077873 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.077835    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:53.087097 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.087074    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdea7eda-331d-4f63-92cf-9769af8ce7ba-sys\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.087237 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.087117    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-wtmp\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.087237 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.087171    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.087237 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.087194    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bdea7eda-331d-4f63-92cf-9769af8ce7ba-root\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.087237 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.087213    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd8zx\" (UniqueName: \"kubernetes.io/projected/bdea7eda-331d-4f63-92cf-9769af8ce7ba-kube-api-access-gd8zx\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.087237 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.087229    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-tls\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.087405 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.087250    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.087405 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.087287    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-textfile\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.087405 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.087328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdea7eda-331d-4f63-92cf-9769af8ce7ba-metrics-client-ca\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.135826 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.135796    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:53.188646 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.188614    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-wtmp\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.188790 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.188660    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.188790 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.188692    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bdea7eda-331d-4f63-92cf-9769af8ce7ba-root\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.188790 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.188716    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd8zx\" (UniqueName: \"kubernetes.io/projected/bdea7eda-331d-4f63-92cf-9769af8ce7ba-kube-api-access-gd8zx\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.188790 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.188739    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-tls\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.188790 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.188775    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.189032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.188796    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-wtmp\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.189032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.188797    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bdea7eda-331d-4f63-92cf-9769af8ce7ba-root\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.189032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.188801    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-textfile\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.189032 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:53.188865    2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 01:08:53.189032 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:53.188943    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-tls podName:bdea7eda-331d-4f63-92cf-9769af8ce7ba nodeName:}" failed. No retries permitted until 2026-07-28 01:08:53.688925842 +0000 UTC m=+266.303233905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-tls") pod "node-exporter-2tnc6" (UID: "bdea7eda-331d-4f63-92cf-9769af8ce7ba") : secret "node-exporter-tls" not found
Jul 28 01:08:53.189032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.188869    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdea7eda-331d-4f63-92cf-9769af8ce7ba-metrics-client-ca\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.189311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.189035    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdea7eda-331d-4f63-92cf-9769af8ce7ba-sys\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.189311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.189098    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdea7eda-331d-4f63-92cf-9769af8ce7ba-sys\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.189311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.189176    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-textfile\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.189519 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.189499    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-accelerators-collector-config\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.189554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.189499    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdea7eda-331d-4f63-92cf-9769af8ce7ba-metrics-client-ca\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.191341 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.191324    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.202155 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.202099    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd8zx\" (UniqueName: \"kubernetes.io/projected/bdea7eda-331d-4f63-92cf-9769af8ce7ba-kube-api-access-gd8zx\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.307665 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.307578    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:53.407036 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.406987    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:53.507267 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.507240    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:53.522174 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.522121    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" podUID="5f23f20f-5203-4927-80e9-052af83d21bd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 28 01:08:53.522321 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.522220    2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9"
Jul 28 01:08:53.522745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.522716    2552 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4be311ab7893357aba98a590a78c0dc8b186e72c713eeee2f0a4eb1f4824ce8d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 28 01:08:53.522821 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.522764    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" podUID="5f23f20f-5203-4927-80e9-052af83d21bd" containerName="service-proxy" containerID="cri-o://4be311ab7893357aba98a590a78c0dc8b186e72c713eeee2f0a4eb1f4824ce8d" gracePeriod=30
Jul 28 01:08:53.607753 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.607673    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:53.693331 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.693307    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-tls\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.695539 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.695510    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bdea7eda-331d-4f63-92cf-9769af8ce7ba-node-exporter-tls\") pod \"node-exporter-2tnc6\" (UID: \"bdea7eda-331d-4f63-92cf-9769af8ce7ba\") " pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.707538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.707491    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:53.808376 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.808337    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:53.904609 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.904584    2552 generic.go:356] "Generic (PLEG): container finished" podID="5f23f20f-5203-4927-80e9-052af83d21bd" containerID="4be311ab7893357aba98a590a78c0dc8b186e72c713eeee2f0a4eb1f4824ce8d" exitCode=2
Jul 28 01:08:53.904772 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.904660    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" event={"ID":"5f23f20f-5203-4927-80e9-052af83d21bd","Type":"ContainerDied","Data":"4be311ab7893357aba98a590a78c0dc8b186e72c713eeee2f0a4eb1f4824ce8d"}
Jul 28 01:08:53.904772 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.904706    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5ff74cff7f-6s9t9" event={"ID":"5f23f20f-5203-4927-80e9-052af83d21bd","Type":"ContainerStarted","Data":"23b4e2c986acc34ebf92fb49e02210bb1e400c196235c4e10c7a0ecd28f1c981"}
Jul 28 01:08:53.934699 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:53.934663    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2tnc6"
Jul 28 01:08:53.945517 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:08:53.945490    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdea7eda_331d_4f63_92cf_9769af8ce7ba.slice/crio-28f324ca209bdcd2e7a91b39993130e1101701cf1f4d11f3c152ec774882350f WatchSource:0}: Error finding container 28f324ca209bdcd2e7a91b39993130e1101701cf1f4d11f3c152ec774882350f: Status 404 returned error can't find the container with id 28f324ca209bdcd2e7a91b39993130e1101701cf1f4d11f3c152ec774882350f
Jul 28 01:08:54.001393 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.001365    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:54.077006 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.076975    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 01:08:54.080228 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.080207    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.082498 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.082475    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 01:08:54.082498 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.082486    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 01:08:54.082710 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.082518    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 01:08:54.082710 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.082565    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 01:08:54.082710 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.082600    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 01:08:54.082710 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.082486    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 01:08:54.082902 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.082726    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 01:08:54.082902 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.082760    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rszkc\""
Jul 28 01:08:54.083122 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.083108    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 01:08:54.083122 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.083117    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 01:08:54.084651 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.084628    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:54.095642 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.095570    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 01:08:54.095902 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.095887    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.095960 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.095915    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.095960 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.095934    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.095960 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.095956    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-config-out\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.096049 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.095996    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.096049 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.096040    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.096159 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.096065    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.096159 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.096111    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.096159 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.096145    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.096273 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.096161    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w7mg\" (UniqueName: \"kubernetes.io/projected/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-kube-api-access-5w7mg\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.096273 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.096184    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.096273 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.096206    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.096273 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.096221    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-web-config\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196539    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196576    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196614    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-config-out\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196901 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196639    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196901 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196666    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196901 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196692    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196901 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:54.196728    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-alertmanager-trusted-ca-bundle podName:7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d nodeName:}" failed. No retries permitted until 2026-07-28 01:08:54.696703897 +0000 UTC m=+267.311011947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d") : configmap references non-existent config key: ca-bundle.crt
Jul 28 01:08:54.196901 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196764    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196901 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196793    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196901 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196817    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w7mg\" (UniqueName: \"kubernetes.io/projected/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-kube-api-access-5w7mg\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196901 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196846    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196901 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196884    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.196901 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:54.196900    2552 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 28 01:08:54.197417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196911    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-web-config\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.197417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.196979    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.197417 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:54.197201    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-main-tls podName:7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d nodeName:}" failed. No retries permitted until 2026-07-28 01:08:54.697181897 +0000 UTC m=+267.311489949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d") : secret "alertmanager-main-tls" not found
Jul 28 01:08:54.197417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.197236    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.198056 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.198027    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.200088 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.200062    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-config-out\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.200206 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.200093    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.200702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.200681    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.201061 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.201021    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.201176 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.201082    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.201823 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.201803    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-web-config\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.201962 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.201945    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.202279 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.202260    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.206616 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.206593    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w7mg\" (UniqueName: \"kubernetes.io/projected/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-kube-api-access-5w7mg\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.701740 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.701702    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.701918 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.701767    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.701977 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:54.701911    2552 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 28 01:08:54.702014 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:08:54.701999    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-main-tls podName:7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d nodeName:}" failed. No retries permitted until 2026-07-28 01:08:55.701970815 +0000 UTC m=+268.316278881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d") : secret "alertmanager-main-tls" not found
Jul 28 01:08:54.702789 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.702765    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:54.770371 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.770339    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:54.911960 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.911926    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tnc6" event={"ID":"bdea7eda-331d-4f63-92cf-9769af8ce7ba","Type":"ContainerStarted","Data":"c34b81ee36738b1e5033dd139c03096fdef8590cf120fc856884224ea008803d"}
Jul 28 01:08:54.912096 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:54.911988    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tnc6" event={"ID":"bdea7eda-331d-4f63-92cf-9769af8ce7ba","Type":"ContainerStarted","Data":"28f324ca209bdcd2e7a91b39993130e1101701cf1f4d11f3c152ec774882350f"}
Jul 28 01:08:55.004106 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.004069    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"]
Jul 28 01:08:55.012089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.012058    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.014411 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.014393    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 01:08:55.014524 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.014452    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 01:08:55.014524 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.014477    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 01:08:55.014765 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.014749    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 01:08:55.014848 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.014756    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 01:08:55.015012 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.014999    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-s8966\""
Jul 28 01:08:55.015062 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.015050    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-choaq71r9ukov\""
Jul 28 01:08:55.018047 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.018029    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"]
Jul 28 01:08:55.105112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.105081    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72a0effb-5ae4-4969-b35c-0662ef863734-metrics-client-ca\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.105288 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.105124    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-tls\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.105288 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.105166    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.105288 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.105256    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.105456 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.105291    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.105456 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.105325    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.105456 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.105348    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-grpc-tls\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.105456 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.105388    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzcnt\" (UniqueName: \"kubernetes.io/projected/72a0effb-5ae4-4969-b35c-0662ef863734-kube-api-access-nzcnt\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.206804 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.206716    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.206804 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.206774    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.206804 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.206803    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.207105 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.206833    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.207105 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.206856    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-grpc-tls\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.207105 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.206894    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzcnt\" (UniqueName: \"kubernetes.io/projected/72a0effb-5ae4-4969-b35c-0662ef863734-kube-api-access-nzcnt\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.207105 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.206975    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72a0effb-5ae4-4969-b35c-0662ef863734-metrics-client-ca\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.207105 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.207025    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-tls\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.208017 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.207894    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72a0effb-5ae4-4969-b35c-0662ef863734-metrics-client-ca\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.209623 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.209562    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.209836 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.209814    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-tls\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.210011 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.209988    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.210096 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.210082    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-grpc-tls\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.210151 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.210115    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.210214 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.210199    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72a0effb-5ae4-4969-b35c-0662ef863734-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.214234 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.214198    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzcnt\" (UniqueName: \"kubernetes.io/projected/72a0effb-5ae4-4969-b35c-0662ef863734-kube-api-access-nzcnt\") pod \"thanos-querier-7b4f8588b9-7dsxr\" (UID: \"72a0effb-5ae4-4969-b35c-0662ef863734\") " pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.321990 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.321949    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:55.454921 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.454885    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"]
Jul 28 01:08:55.458418 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:08:55.458368    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a0effb_5ae4_4969_b35c_0662ef863734.slice/crio-b852064e1dd51bf3b47d09ba4387051f6f318a9294e4c792520c50e22b49e49d WatchSource:0}: Error finding container b852064e1dd51bf3b47d09ba4387051f6f318a9294e4c792520c50e22b49e49d: Status 404 returned error can't find the container with id b852064e1dd51bf3b47d09ba4387051f6f318a9294e4c792520c50e22b49e49d
Jul 28 01:08:55.711360 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.711280    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:55.713758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.713729    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:55.890690 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.890660    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 01:08:55.917404 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.917378    2552 generic.go:356] "Generic (PLEG): container finished" podID="bdea7eda-331d-4f63-92cf-9769af8ce7ba" containerID="c34b81ee36738b1e5033dd139c03096fdef8590cf120fc856884224ea008803d" exitCode=0
Jul 28 01:08:55.917551 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.917449    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tnc6" event={"ID":"bdea7eda-331d-4f63-92cf-9769af8ce7ba","Type":"ContainerDied","Data":"c34b81ee36738b1e5033dd139c03096fdef8590cf120fc856884224ea008803d"}
Jul 28 01:08:55.918780 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.918757    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr" event={"ID":"72a0effb-5ae4-4969-b35c-0662ef863734","Type":"ContainerStarted","Data":"b852064e1dd51bf3b47d09ba4387051f6f318a9294e4c792520c50e22b49e49d"}
Jul 28 01:08:55.930339 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.930318    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:55.985701 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:55.985680    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:56.051940 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:56.051917    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 01:08:56.053259 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:08:56.053235    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b20a5a5_c0cb_4fb6_b441_c12301bc4e9d.slice/crio-20ea7ca338be163948ea1080871166da0c30a4a49199da2d004c70cf62613d65 WatchSource:0}: Error finding container 20ea7ca338be163948ea1080871166da0c30a4a49199da2d004c70cf62613d65: Status 404 returned error can't find the container with id 20ea7ca338be163948ea1080871166da0c30a4a49199da2d004c70cf62613d65
Jul 28 01:08:56.227382 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:56.227351    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:56.278079 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:56.278001    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:56.923803 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:56.923764    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d","Type":"ContainerStarted","Data":"20ea7ca338be163948ea1080871166da0c30a4a49199da2d004c70cf62613d65"}
Jul 28 01:08:56.926206 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:56.926181    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tnc6" event={"ID":"bdea7eda-331d-4f63-92cf-9769af8ce7ba","Type":"ContainerStarted","Data":"612929782c268c0c5321fa7b1206344c3c7023b9a2518e7271535a64b8d93468"}
Jul 28 01:08:56.926327 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:56.926233    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2tnc6" event={"ID":"bdea7eda-331d-4f63-92cf-9769af8ce7ba","Type":"ContainerStarted","Data":"e07551cc6281a67f3196ee57e35ee660751cfd475bd14bf153033248ea19356b"}
Jul 28 01:08:56.945700 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:56.945644    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2tnc6" podStartSLOduration=3.004521826 podStartE2EDuration="3.945624733s" totalImagesPullingTime="865.280659ms" totalInitContainerRuntime="75.822248ms" isStatefulPod=true podCreationTimestamp="2026-07-28 01:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:08:56.943171282 +0000 UTC m=+269.557479356" watchObservedRunningTime="2026-07-28 01:08:56.945624733 +0000 UTC m=+269.559932806"
Jul 28 01:08:57.113183 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:57.113117    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:57.183272 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:57.183198    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:57.793958 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:57.793928    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:57.891232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:57.891125    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:57.933041 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:57.932958    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr" event={"ID":"72a0effb-5ae4-4969-b35c-0662ef863734","Type":"ContainerStarted","Data":"461a89206b3fef734740bbc4dfa47050279aadabb7db5791cf0634c4dbb05899"}
Jul 28 01:08:57.933219 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:57.933064    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr" event={"ID":"72a0effb-5ae4-4969-b35c-0662ef863734","Type":"ContainerStarted","Data":"9ddfe85d6929069dfc738b3f96646393d1b5d819561a23ac25f944a39f28be9b"}
Jul 28 01:08:57.933219 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:57.933093    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr" event={"ID":"72a0effb-5ae4-4969-b35c-0662ef863734","Type":"ContainerStarted","Data":"e515c84dda3677f0d82754887ecdee3e30aaf0d5f119176102fcb5c7a6b1b995"}
Jul 28 01:08:57.934408 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:57.934386    2552 generic.go:356] "Generic (PLEG): container finished" podID="7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d" containerID="f9809df2c9cf25020d72d6b6111c80ce71c5866090efcf957ff684d3424407cd" exitCode=0
Jul 28 01:08:57.934505 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:57.934440    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d","Type":"ContainerDied","Data":"f9809df2c9cf25020d72d6b6111c80ce71c5866090efcf957ff684d3424407cd"}
Jul 28 01:08:57.961630 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:57.961598    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:58.940509 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:58.940482    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr" event={"ID":"72a0effb-5ae4-4969-b35c-0662ef863734","Type":"ContainerStarted","Data":"3e03ab6709b62ff40e57a0ef071886808506a406af78ce532d5cff18207c719c"}
Jul 28 01:08:59.192452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.192354    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:08:59.950886 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.950851    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d","Type":"ContainerStarted","Data":"74cb21b1fd1ec325cae8cd8bf3729cd5e539513dfacb859df8293a62a689e057"}
Jul 28 01:08:59.951363 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.950950    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d","Type":"ContainerStarted","Data":"3c205f4310e6cfd909187c4a2e899e604829a19654984196f76562cadbf0ea54"}
Jul 28 01:08:59.951363 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.950981    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d","Type":"ContainerStarted","Data":"f30f1b3ea5f466791afcd8319abbfa1336bd814d968e07055ef50ff035f11dd1"}
Jul 28 01:08:59.951363 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.951011    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d","Type":"ContainerStarted","Data":"e14190dba6c657aec34c353de4db1c826da956a562fc4db3b18e2d6a1b8de800"}
Jul 28 01:08:59.951363 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.951058    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d","Type":"ContainerStarted","Data":"87facba968d72becb0b144e181d449d0958dc09db9eadbe544399ca10b3d1e84"}
Jul 28 01:08:59.951363 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.951088    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d","Type":"ContainerStarted","Data":"c54bda52d9707a7dad0ac2a580d622c60ea87ebd2ac846137c9e1914da47021d"}
Jul 28 01:08:59.953780 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.953758    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr" event={"ID":"72a0effb-5ae4-4969-b35c-0662ef863734","Type":"ContainerStarted","Data":"ef25fa03cd5ac28ff69e11689c5d36a34f2bb6dda975b864bbd22aa52a6ba26f"}
Jul 28 01:08:59.953888 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.953805    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr" event={"ID":"72a0effb-5ae4-4969-b35c-0662ef863734","Type":"ContainerStarted","Data":"a5c3b41dd495092212164c5bfa677c5204fb45822b69c3fd374363a94b1ae272"}
Jul 28 01:08:59.953943 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.953925    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:08:59.977332 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.977250    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.838586796 podStartE2EDuration="5.977231493s" totalImagesPullingTime="3.11960721s" totalInitContainerRuntime="19.037487ms" isStatefulPod=false podCreationTimestamp="2026-07-28 01:08:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:08:59.975411947 +0000 UTC m=+272.589720029" watchObservedRunningTime="2026-07-28 01:08:59.977231493 +0000 UTC m=+272.591539565"
Jul 28 01:08:59.996471 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:08:59.996427    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr" podStartSLOduration=2.8862559819999998 podStartE2EDuration="5.996411158s" totalImagesPullingTime="3.110155176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:08:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:08:59.995124854 +0000 UTC m=+272.609432947" watchObservedRunningTime="2026-07-28 01:08:59.996411158 +0000 UTC m=+272.610719229"
Jul 28 01:09:00.130182 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:00.130115    2552 patch_prober.go:28] interesting pod/image-registry-6b57d68984-5t4kr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 01:09:00.130327 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:00.130200    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" podUID="17539a90-1dd8-4e74-a3bc-09dbfcd42049" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:09:01.866335 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:01.866305    2552 patch_prober.go:28] interesting pod/image-registry-6b57d68984-5t4kr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 01:09:01.866706 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:01.866357    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" podUID="17539a90-1dd8-4e74-a3bc-09dbfcd42049" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:09:03.703509 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:03.703463    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:03.812202 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:03.812114    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:05.714623 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:05.714558    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:05.814923 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:05.814883    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:05.963502 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:05.963480    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b4f8588b9-7dsxr"
Jul 28 01:09:08.566384 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:09:08.566338    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pwt7t" podUID="14f3bcef-9b2a-4664-9f55-d39a858cd433"
Jul 28 01:09:08.986741 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:08.986706    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:09:10.129146 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:10.129106    2552 patch_prober.go:28] interesting pod/image-registry-6b57d68984-5t4kr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 01:09:10.129497 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:10.129171    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" podUID="17539a90-1dd8-4e74-a3bc-09dbfcd42049" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:09:11.866908 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:11.866869    2552 patch_prober.go:28] interesting pod/image-registry-6b57d68984-5t4kr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 01:09:11.867417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:11.866921    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" podUID="17539a90-1dd8-4e74-a3bc-09dbfcd42049" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:09:12.249756 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:12.249724    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:09:12.252117 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:12.252088    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f3bcef-9b2a-4664-9f55-d39a858cd433-metrics-tls\") pod \"dns-default-pwt7t\" (UID: \"14f3bcef-9b2a-4664-9f55-d39a858cd433\") " pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:09:12.290080 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:12.290050    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9pqrg\""
Jul 28 01:09:12.298060 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:12.298031    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:09:12.701929 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:12.701895    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pwt7t"]
Jul 28 01:09:12.704999 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:09:12.704969    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f3bcef_9b2a_4664_9f55_d39a858cd433.slice/crio-92195b40c31fc953152357e7ef8af2dcdcb9cd4bbaab9ab0cdff47757ce8fc5c WatchSource:0}: Error finding container 92195b40c31fc953152357e7ef8af2dcdcb9cd4bbaab9ab0cdff47757ce8fc5c: Status 404 returned error can't find the container with id 92195b40c31fc953152357e7ef8af2dcdcb9cd4bbaab9ab0cdff47757ce8fc5c
Jul 28 01:09:13.002068 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:13.002037    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwt7t" event={"ID":"14f3bcef-9b2a-4664-9f55-d39a858cd433","Type":"ContainerStarted","Data":"92195b40c31fc953152357e7ef8af2dcdcb9cd4bbaab9ab0cdff47757ce8fc5c"}
Jul 28 01:09:15.012098 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:15.012062    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwt7t" event={"ID":"14f3bcef-9b2a-4664-9f55-d39a858cd433","Type":"ContainerStarted","Data":"73ccd9ddf792d4197eea2a9f5f1395e1c2e66b32be0c99a51b9c85a7c1638734"}
Jul 28 01:09:15.012488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:15.012124    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pwt7t" event={"ID":"14f3bcef-9b2a-4664-9f55-d39a858cd433","Type":"ContainerStarted","Data":"bfa967d30e66fb7932024a31c7fadabc21c7ee68686ca9db619f42d2c0d2c9cd"}
Jul 28 01:09:15.012488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:15.012196    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:09:15.029560 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:15.029520    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pwt7t" podStartSLOduration=251.300064297 podStartE2EDuration="4m13.029504178s" totalImagesPullingTime="1.729439881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:09:15.02797112 +0000 UTC m=+287.642279202" watchObservedRunningTime="2026-07-28 01:09:15.029504178 +0000 UTC m=+287.643812249"
Jul 28 01:09:15.275355 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:15.275260    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:15.375344 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:15.375312    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:20.130272 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:20.130239    2552 patch_prober.go:28] interesting pod/image-registry-6b57d68984-5t4kr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 01:09:20.130733 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:20.130288    2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" podUID="17539a90-1dd8-4e74-a3bc-09dbfcd42049" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:09:20.130733 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:20.130333    2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:09:20.130844 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:20.130739    2552 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"7b3cd4a03c146633c90bf07647677d08677479990b39a713a3477b3a1bd99fd1"} pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 28 01:09:20.134344 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:20.134317    2552 patch_prober.go:28] interesting pod/image-registry-6b57d68984-5t4kr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 28 01:09:20.134547 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:20.134478    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" podUID="17539a90-1dd8-4e74-a3bc-09dbfcd42049" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:09:21.118802 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:21.118745    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:21.172053 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:21.172025    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:21.699332 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:21.699298    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:21.800251 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:21.800215    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:21.997014 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:21.996931    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:22.054989 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:22.054958    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:22.784865 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:22.784817    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:22.834248 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:22.834218    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:25.018976 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:25.018942    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pwt7t"
Jul 28 01:09:25.123284 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:25.123255    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:25.174795 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:25.174767    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:27.814791 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:27.814763    2552 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 01:09:28.024112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:28.023986    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:28.070679 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:28.070618    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:28.124201 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:28.124173    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:30.136010 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:30.135978    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:09:30.253327 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:30.253292    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:30.354595 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:30.354562    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:30.455118 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:30.455005    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:30.555178 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:30.555148    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:31.475864 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:31.475830    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:31.577089 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:31.577055    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:34.584310 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:34.584280    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:34.686442 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:34.686412    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:35.527553 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:35.527527    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dw9b8_b285aad5-dd32-4ce5-9dbd-7f6c66bade91/serve-healthcheck-canary/0.log"
Jul 28 01:09:36.132922 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:36.132880    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:36.233953 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:36.233919    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:36.333582 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:36.333550    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:40.550833 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:40.550800    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:40.604784 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:40.604737    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:45.149595 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:45.149550    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" podUID="17539a90-1dd8-4e74-a3bc-09dbfcd42049" containerName="registry" containerID="cri-o://7b3cd4a03c146633c90bf07647677d08677479990b39a713a3477b3a1bd99fd1" gracePeriod=30
Jul 28 01:09:47.126866 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:47.126836    2552 generic.go:356] "Generic (PLEG): container finished" podID="17539a90-1dd8-4e74-a3bc-09dbfcd42049" containerID="7b3cd4a03c146633c90bf07647677d08677479990b39a713a3477b3a1bd99fd1" exitCode=0
Jul 28 01:09:47.127292 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:47.126914    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" event={"ID":"17539a90-1dd8-4e74-a3bc-09dbfcd42049","Type":"ContainerDied","Data":"7b3cd4a03c146633c90bf07647677d08677479990b39a713a3477b3a1bd99fd1"}
Jul 28 01:09:47.127292 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:47.126961    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr" event={"ID":"17539a90-1dd8-4e74-a3bc-09dbfcd42049","Type":"ContainerStarted","Data":"6f2bde34523d7ea478aca50fc1bbd7f8d79c98515dc9fa8373ad6346a47280a4"}
Jul 28 01:09:47.127292 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:47.126989    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:09:47.384825 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:47.384785    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:47.485622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:47.485579    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:51.125743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:51.125712    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:51.174298 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:51.174265    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:56.798154 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:56.798096    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:56.900268 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:56.900236    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:09:57.000090 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:09:57.000059    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:06.119985 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:06.119946    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:06.175195 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:06.175107    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:08.136067 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:08.135660    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b57d68984-5t4kr"
Jul 28 01:10:08.400819 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:08.400740    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:08.451482 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:08.451453    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:09.058905 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:09.058846    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:09.115412 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:09.115382    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:17.698928 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:17.698843    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:17.798171 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:17.798122    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:18.164826 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:18.164791    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:18.301880 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:18.301852    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:18.358804 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:18.358778    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:18.908846 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:18.908816    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:19.007055 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:19.007013    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:21.127006 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:21.126974    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:21.228180 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:21.228150    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:24.885301 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:24.885265    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:24.986032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:24.986004    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:29.073062 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:29.073032    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:29.133780 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:29.133757    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:29.192219 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:29.192181    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:50.124393 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.124360    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:50.224842 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.224809    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:10:50.716677 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.716649    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"]
Jul 28 01:10:50.719080 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.719056    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:50.721530 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.721509    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 01:10:50.721625 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.721509    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 01:10:50.722369 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.722355    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-skk9x\""
Jul 28 01:10:50.733028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.733009    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"]
Jul 28 01:10:50.824513 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.824480    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:50.824678 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.824524    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:50.824678 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.824559    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76qnr\" (UniqueName: \"kubernetes.io/projected/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-kube-api-access-76qnr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:50.925380 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.925347    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:50.925534 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.925397    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:50.925534 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.925437    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76qnr\" (UniqueName: \"kubernetes.io/projected/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-kube-api-access-76qnr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:50.925790 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.925769    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:50.925830 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.925783    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:50.933410 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:50.933379    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76qnr\" (UniqueName: \"kubernetes.io/projected/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-kube-api-access-76qnr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:51.027767 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:51.027676    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:10:51.153185 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:51.153122    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"]
Jul 28 01:10:51.156968 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:10:51.156941    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd381c3c3_4cad_41b1_bba3_3cc2745e20d0.slice/crio-f69887a0dbfb865a7fb482c064af654c200d3deac1bde7c1f4d2bbbd9b2c85f8 WatchSource:0}: Error finding container f69887a0dbfb865a7fb482c064af654c200d3deac1bde7c1f4d2bbbd9b2c85f8: Status 404 returned error can't find the container with id f69887a0dbfb865a7fb482c064af654c200d3deac1bde7c1f4d2bbbd9b2c85f8
Jul 28 01:10:51.158862 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:51.158843    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:10:51.362648 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:51.362565    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m" event={"ID":"d381c3c3-4cad-41b1-bba3-3cc2745e20d0","Type":"ContainerStarted","Data":"f69887a0dbfb865a7fb482c064af654c200d3deac1bde7c1f4d2bbbd9b2c85f8"}
Jul 28 01:10:58.390503 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:58.390473    2552 generic.go:356] "Generic (PLEG): container finished" podID="d381c3c3-4cad-41b1-bba3-3cc2745e20d0" containerID="2568fb8d4ccc0d399ab3e4129f353c851102baa0acceeed1f3c4704b05be9e9d" exitCode=0
Jul 28 01:10:58.390940 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:10:58.390531    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m" event={"ID":"d381c3c3-4cad-41b1-bba3-3cc2745e20d0","Type":"ContainerDied","Data":"2568fb8d4ccc0d399ab3e4129f353c851102baa0acceeed1f3c4704b05be9e9d"}
Jul 28 01:11:05.417356 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:05.417319    2552 generic.go:356] "Generic (PLEG): container finished" podID="d381c3c3-4cad-41b1-bba3-3cc2745e20d0" containerID="acd40ab3aacc577dd2b00b457ac9b42fb54d6a9485df05c2c09b5ee2dff7eb07" exitCode=0
Jul 28 01:11:05.417778 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:05.417374    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m" event={"ID":"d381c3c3-4cad-41b1-bba3-3cc2745e20d0","Type":"ContainerDied","Data":"acd40ab3aacc577dd2b00b457ac9b42fb54d6a9485df05c2c09b5ee2dff7eb07"}
Jul 28 01:11:05.511924 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:05.511889    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:14.457605 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:14.457561    2552 generic.go:356] "Generic (PLEG): container finished" podID="d381c3c3-4cad-41b1-bba3-3cc2745e20d0" containerID="819816a9c1ce592fefc923c7b3caf02dd34b3f84337e26d6d255bd10ad4393a1" exitCode=0
Jul 28 01:11:14.457984 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:14.457652    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m" event={"ID":"d381c3c3-4cad-41b1-bba3-3cc2745e20d0","Type":"ContainerDied","Data":"819816a9c1ce592fefc923c7b3caf02dd34b3f84337e26d6d255bd10ad4393a1"}
Jul 28 01:11:15.625777 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:15.625743    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:11:15.732364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:15.732274    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-bundle\") pod \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") "
Jul 28 01:11:15.732364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:15.732324    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76qnr\" (UniqueName: \"kubernetes.io/projected/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-kube-api-access-76qnr\") pod \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") "
Jul 28 01:11:15.732364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:15.732350    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-util\") pod \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\" (UID: \"d381c3c3-4cad-41b1-bba3-3cc2745e20d0\") "
Jul 28 01:11:15.733047 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:15.733026    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-bundle" (OuterVolumeSpecName: "bundle") pod "d381c3c3-4cad-41b1-bba3-3cc2745e20d0" (UID: "d381c3c3-4cad-41b1-bba3-3cc2745e20d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:11:15.734754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:15.734721    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-kube-api-access-76qnr" (OuterVolumeSpecName: "kube-api-access-76qnr") pod "d381c3c3-4cad-41b1-bba3-3cc2745e20d0" (UID: "d381c3c3-4cad-41b1-bba3-3cc2745e20d0"). InnerVolumeSpecName "kube-api-access-76qnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:11:15.736348 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:15.736327    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-util" (OuterVolumeSpecName: "util") pod "d381c3c3-4cad-41b1-bba3-3cc2745e20d0" (UID: "d381c3c3-4cad-41b1-bba3-3cc2745e20d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:11:15.833088 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:15.833054    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:11:15.833088 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:15.833086    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76qnr\" (UniqueName: \"kubernetes.io/projected/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-kube-api-access-76qnr\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:11:15.833088 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:15.833097    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d381c3c3-4cad-41b1-bba3-3cc2745e20d0-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:11:16.467745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:16.467709    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m" event={"ID":"d381c3c3-4cad-41b1-bba3-3cc2745e20d0","Type":"ContainerDied","Data":"f69887a0dbfb865a7fb482c064af654c200d3deac1bde7c1f4d2bbbd9b2c85f8"}
Jul 28 01:11:16.467910 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:16.467761    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ksp4m"
Jul 28 01:11:16.467910 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:16.467767    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f69887a0dbfb865a7fb482c064af654c200d3deac1bde7c1f4d2bbbd9b2c85f8"
Jul 28 01:11:21.769835 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:21.769725    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:22.157083 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:22.157050    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:22.586864 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:22.586731    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:25.425584 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:25.425557    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:25.474413 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:25.474361    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:27.461149 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:27.461086    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:27.565307 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:27.565275    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:27.869718 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:27.869606    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:27.976376 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:27.976344    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:28.073143 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:28.073091    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:29.765523 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:29.765492    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:30.125619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:30.125478    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:30.307355 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:30.307304    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:32.377873 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:32.377824    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:32.431187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:32.431158    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:36.534960 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:36.534924    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:36.585749 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:36.585648    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:39.120875 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:39.120777    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:40.660884 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.660849    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-94v4p"]
Jul 28 01:11:40.661316 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.661118    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d381c3c3-4cad-41b1-bba3-3cc2745e20d0" containerName="pull"
Jul 28 01:11:40.661316 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.661143    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d381c3c3-4cad-41b1-bba3-3cc2745e20d0" containerName="pull"
Jul 28 01:11:40.661316 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.661152    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d381c3c3-4cad-41b1-bba3-3cc2745e20d0" containerName="extract"
Jul 28 01:11:40.661316 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.661159    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d381c3c3-4cad-41b1-bba3-3cc2745e20d0" containerName="extract"
Jul 28 01:11:40.661316 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.661171    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d381c3c3-4cad-41b1-bba3-3cc2745e20d0" containerName="util"
Jul 28 01:11:40.661316 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.661176    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d381c3c3-4cad-41b1-bba3-3cc2745e20d0" containerName="util"
Jul 28 01:11:40.661316 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.661222    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d381c3c3-4cad-41b1-bba3-3cc2745e20d0" containerName="extract"
Jul 28 01:11:40.666749 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.666722    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-94v4p"
Jul 28 01:11:40.670149 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.670107    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 01:11:40.670270 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.670198    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 01:11:40.670270 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.670210    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tc2fx\""
Jul 28 01:11:40.670270 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.670246    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-94v4p"]
Jul 28 01:11:40.728995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.728960    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmcfr\" (UniqueName: \"kubernetes.io/projected/25fc1f53-c3aa-40e5-8592-f90a68bbc7ef-kube-api-access-gmcfr\") pod \"cert-manager-55b4d954d5-94v4p\" (UID: \"25fc1f53-c3aa-40e5-8592-f90a68bbc7ef\") " pod="cert-manager/cert-manager-55b4d954d5-94v4p"
Jul 28 01:11:40.729161 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.729010    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25fc1f53-c3aa-40e5-8592-f90a68bbc7ef-bound-sa-token\") pod \"cert-manager-55b4d954d5-94v4p\" (UID: \"25fc1f53-c3aa-40e5-8592-f90a68bbc7ef\") " pod="cert-manager/cert-manager-55b4d954d5-94v4p"
Jul 28 01:11:40.829827 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.829795    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcfr\" (UniqueName: \"kubernetes.io/projected/25fc1f53-c3aa-40e5-8592-f90a68bbc7ef-kube-api-access-gmcfr\") pod \"cert-manager-55b4d954d5-94v4p\" (UID: \"25fc1f53-c3aa-40e5-8592-f90a68bbc7ef\") " pod="cert-manager/cert-manager-55b4d954d5-94v4p"
Jul 28 01:11:40.829935 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.829850    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25fc1f53-c3aa-40e5-8592-f90a68bbc7ef-bound-sa-token\") pod \"cert-manager-55b4d954d5-94v4p\" (UID: \"25fc1f53-c3aa-40e5-8592-f90a68bbc7ef\") " pod="cert-manager/cert-manager-55b4d954d5-94v4p"
Jul 28 01:11:40.837600 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.837574    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/25fc1f53-c3aa-40e5-8592-f90a68bbc7ef-bound-sa-token\") pod \"cert-manager-55b4d954d5-94v4p\" (UID: \"25fc1f53-c3aa-40e5-8592-f90a68bbc7ef\") " pod="cert-manager/cert-manager-55b4d954d5-94v4p"
Jul 28 01:11:40.837701 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.837665    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmcfr\" (UniqueName: \"kubernetes.io/projected/25fc1f53-c3aa-40e5-8592-f90a68bbc7ef-kube-api-access-gmcfr\") pod \"cert-manager-55b4d954d5-94v4p\" (UID: \"25fc1f53-c3aa-40e5-8592-f90a68bbc7ef\") " pod="cert-manager/cert-manager-55b4d954d5-94v4p"
Jul 28 01:11:40.976707 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:40.976628    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-94v4p"
Jul 28 01:11:41.104201 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:41.104151    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-94v4p"]
Jul 28 01:11:41.106346 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:11:41.106312    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod25fc1f53_c3aa_40e5_8592_f90a68bbc7ef.slice/crio-96fa8d52ee3c76aed980d916e6e27cd5363a7a3e116847a1d56f8f7724192f6a WatchSource:0}: Error finding container 96fa8d52ee3c76aed980d916e6e27cd5363a7a3e116847a1d56f8f7724192f6a: Status 404 returned error can't find the container with id 96fa8d52ee3c76aed980d916e6e27cd5363a7a3e116847a1d56f8f7724192f6a
Jul 28 01:11:41.564544 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:41.564511    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-94v4p" event={"ID":"25fc1f53-c3aa-40e5-8592-f90a68bbc7ef","Type":"ContainerStarted","Data":"96fa8d52ee3c76aed980d916e6e27cd5363a7a3e116847a1d56f8f7724192f6a"}
Jul 28 01:11:44.560798 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:44.560757    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:44.576990 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:44.576961    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-94v4p" event={"ID":"25fc1f53-c3aa-40e5-8592-f90a68bbc7ef","Type":"ContainerStarted","Data":"b7d5c45c36d67ffccdc88a890cdd85b9936f18125265f7eeb2ef9bbc7dc9b506"}
Jul 28 01:11:44.591067 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:44.591016    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-94v4p" podStartSLOduration=1.804872698 podStartE2EDuration="4.591000232s" totalImagesPullingTime="2.786127534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:11:44.590385032 +0000 UTC m=+437.204693104" watchObservedRunningTime="2026-07-28 01:11:44.591000232 +0000 UTC m=+437.205308309"
Jul 28 01:11:48.721728 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:48.721621    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:48.776116 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:48.776086    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:54.914538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:54.914459    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:55.014477 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:55.014439    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:11:59.917579 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:11:59.917546    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:00.022506 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:00.022471    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:01.949904 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:01.949862    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"]
Jul 28 01:12:01.952545 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:01.952527    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:01.954986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:01.954959    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 01:12:01.955913 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:01.955884    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-skk9x\""
Jul 28 01:12:01.956027 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:01.955894    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 01:12:01.960369 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:01.960346    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"]
Jul 28 01:12:01.989684 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:01.989644    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:01.989684 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:01.989688    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njzls\" (UniqueName: \"kubernetes.io/projected/ee56d356-936b-421d-b541-5d9618f75450-kube-api-access-njzls\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:01.989917 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:01.989729    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:02.088186 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.088155    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:02.090099 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.090082    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:02.090196 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.090123    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njzls\" (UniqueName: \"kubernetes.io/projected/ee56d356-936b-421d-b541-5d9618f75450-kube-api-access-njzls\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:02.090301 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.090282    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:02.090520 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.090501    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:02.090606 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.090590    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:02.101259 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.101233    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njzls\" (UniqueName: \"kubernetes.io/projected/ee56d356-936b-421d-b541-5d9618f75450-kube-api-access-njzls\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:02.262365 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.262257    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:02.392041 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.391904    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"]
Jul 28 01:12:02.394652 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:12:02.394608    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee56d356_936b_421d_b541_5d9618f75450.slice/crio-114b0eeeda325f1027bc1ea6331f38e4b5a509efc4b5979f4c05f476dad09789 WatchSource:0}: Error finding container 114b0eeeda325f1027bc1ea6331f38e4b5a509efc4b5979f4c05f476dad09789: Status 404 returned error can't find the container with id 114b0eeeda325f1027bc1ea6331f38e4b5a509efc4b5979f4c05f476dad09789
Jul 28 01:12:02.649433 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.649401    2552 generic.go:356] "Generic (PLEG): container finished" podID="ee56d356-936b-421d-b541-5d9618f75450" containerID="acf74b925759044d422cda1831b57c766faafafc66922496e50f9cae51c7a3ca" exitCode=0
Jul 28 01:12:02.649621 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.649461    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g" event={"ID":"ee56d356-936b-421d-b541-5d9618f75450","Type":"ContainerDied","Data":"acf74b925759044d422cda1831b57c766faafafc66922496e50f9cae51c7a3ca"}
Jul 28 01:12:02.649621 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:02.649496    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g" event={"ID":"ee56d356-936b-421d-b541-5d9618f75450","Type":"ContainerStarted","Data":"114b0eeeda325f1027bc1ea6331f38e4b5a509efc4b5979f4c05f476dad09789"}
Jul 28 01:12:03.654943 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:03.654911    2552 generic.go:356] "Generic (PLEG): container finished" podID="ee56d356-936b-421d-b541-5d9618f75450" containerID="aa15c37757f587a868cdcc6ad0ab8bae13700e9d3e70e3890ae9a9e8fd6bc4e0" exitCode=0
Jul 28 01:12:03.655403 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:03.654948    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g" event={"ID":"ee56d356-936b-421d-b541-5d9618f75450","Type":"ContainerDied","Data":"aa15c37757f587a868cdcc6ad0ab8bae13700e9d3e70e3890ae9a9e8fd6bc4e0"}
Jul 28 01:12:04.660470 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:04.660435    2552 generic.go:356] "Generic (PLEG): container finished" podID="ee56d356-936b-421d-b541-5d9618f75450" containerID="998c60d5954b78f8795ff50c9b0be82b4099fe747a487b83e956186aa07bf01e" exitCode=0
Jul 28 01:12:04.660842 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:04.660505    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g" event={"ID":"ee56d356-936b-421d-b541-5d9618f75450","Type":"ContainerDied","Data":"998c60d5954b78f8795ff50c9b0be82b4099fe747a487b83e956186aa07bf01e"}
Jul 28 01:12:05.791486 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:05.791461    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:05.820198 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:05.820167    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-util\") pod \"ee56d356-936b-421d-b541-5d9618f75450\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") "
Jul 28 01:12:05.820384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:05.820255    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njzls\" (UniqueName: \"kubernetes.io/projected/ee56d356-936b-421d-b541-5d9618f75450-kube-api-access-njzls\") pod \"ee56d356-936b-421d-b541-5d9618f75450\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") "
Jul 28 01:12:05.820384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:05.820311    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-bundle\") pod \"ee56d356-936b-421d-b541-5d9618f75450\" (UID: \"ee56d356-936b-421d-b541-5d9618f75450\") "
Jul 28 01:12:05.821013 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:05.820987    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-bundle" (OuterVolumeSpecName: "bundle") pod "ee56d356-936b-421d-b541-5d9618f75450" (UID: "ee56d356-936b-421d-b541-5d9618f75450"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:12:05.822611 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:05.822584    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee56d356-936b-421d-b541-5d9618f75450-kube-api-access-njzls" (OuterVolumeSpecName: "kube-api-access-njzls") pod "ee56d356-936b-421d-b541-5d9618f75450" (UID: "ee56d356-936b-421d-b541-5d9618f75450"). InnerVolumeSpecName "kube-api-access-njzls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:12:05.825775 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:05.825751    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-util" (OuterVolumeSpecName: "util") pod "ee56d356-936b-421d-b541-5d9618f75450" (UID: "ee56d356-936b-421d-b541-5d9618f75450"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:12:05.921758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:05.921670    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:12:05.921758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:05.921703    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee56d356-936b-421d-b541-5d9618f75450-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:12:05.921758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:05.921712    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njzls\" (UniqueName: \"kubernetes.io/projected/ee56d356-936b-421d-b541-5d9618f75450-kube-api-access-njzls\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:12:06.669230 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:06.669194    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g" event={"ID":"ee56d356-936b-421d-b541-5d9618f75450","Type":"ContainerDied","Data":"114b0eeeda325f1027bc1ea6331f38e4b5a509efc4b5979f4c05f476dad09789"}
Jul 28 01:12:06.669230 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:06.669229    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afcz89g"
Jul 28 01:12:06.669430 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:06.669241    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="114b0eeeda325f1027bc1ea6331f38e4b5a509efc4b5979f4c05f476dad09789"
Jul 28 01:12:12.292292 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:12.292251    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:12.371444 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:12.371409    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:15.467965 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:15.467925    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:15.571458 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:15.571427    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:16.103781 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.103750    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:16.317095 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.317063    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:16.424824 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.424797    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:16.443820 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.443798    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"]
Jul 28 01:12:16.444064 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.444053    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee56d356-936b-421d-b541-5d9618f75450" containerName="extract"
Jul 28 01:12:16.444112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.444067    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee56d356-936b-421d-b541-5d9618f75450" containerName="extract"
Jul 28 01:12:16.444112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.444087    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee56d356-936b-421d-b541-5d9618f75450" containerName="pull"
Jul 28 01:12:16.444112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.444093    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee56d356-936b-421d-b541-5d9618f75450" containerName="pull"
Jul 28 01:12:16.444112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.444103    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee56d356-936b-421d-b541-5d9618f75450" containerName="util"
Jul 28 01:12:16.444112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.444109    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee56d356-936b-421d-b541-5d9618f75450" containerName="util"
Jul 28 01:12:16.444280 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.444181    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee56d356-936b-421d-b541-5d9618f75450" containerName="extract"
Jul 28 01:12:16.480304 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.480273    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"]
Jul 28 01:12:16.480670 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.480376    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.486288 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.486268    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 01:12:16.486660 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.486628    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 01:12:16.486924 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.486855    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b7f4g\""
Jul 28 01:12:16.487294 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.487049    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 01:12:16.489047 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.489032    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 01:12:16.604800 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.604758    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9371e3b4-8749-4120-91bd-d3be13cd4812-tmp\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.604968 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.604819    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9371e3b4-8749-4120-91bd-d3be13cd4812-manifests\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.604968 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.604838    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9371e3b4-8749-4120-91bd-d3be13cd4812-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.604968 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.604865    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9371e3b4-8749-4120-91bd-d3be13cd4812-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.604968 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.604882    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlk4h\" (UniqueName: \"kubernetes.io/projected/9371e3b4-8749-4120-91bd-d3be13cd4812-kube-api-access-tlk4h\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.614903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.614874    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:16.705643 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.705557    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9371e3b4-8749-4120-91bd-d3be13cd4812-manifests\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.705643 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.705590    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9371e3b4-8749-4120-91bd-d3be13cd4812-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.705643 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.705628    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9371e3b4-8749-4120-91bd-d3be13cd4812-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.705895 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.705659    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlk4h\" (UniqueName: \"kubernetes.io/projected/9371e3b4-8749-4120-91bd-d3be13cd4812-kube-api-access-tlk4h\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.705895 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.705709    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9371e3b4-8749-4120-91bd-d3be13cd4812-tmp\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.706063 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.706042    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9371e3b4-8749-4120-91bd-d3be13cd4812-manifests\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.708298 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.708276    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9371e3b4-8749-4120-91bd-d3be13cd4812-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.708675 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.708644    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9371e3b4-8749-4120-91bd-d3be13cd4812-tmp\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.708814 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.708798    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9371e3b4-8749-4120-91bd-d3be13cd4812-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.714982 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.714952    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:16.715524 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.715502    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlk4h\" (UniqueName: \"kubernetes.io/projected/9371e3b4-8749-4120-91bd-d3be13cd4812-kube-api-access-tlk4h\") pod \"opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n\" (UID: \"9371e3b4-8749-4120-91bd-d3be13cd4812\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.790504 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.790464    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:16.815331 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.815307    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:16.909677 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.909637    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:16.923249 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.923229    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"]
Jul 28 01:12:16.925755 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:12:16.925730    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9371e3b4_8749_4120_91bd_d3be13cd4812.slice/crio-884ed36e3e8ab5c5b2d45704d554c0d33fdcce1f43c508f1fb5c9539a8345999 WatchSource:0}: Error finding container 884ed36e3e8ab5c5b2d45704d554c0d33fdcce1f43c508f1fb5c9539a8345999: Status 404 returned error can't find the container with id 884ed36e3e8ab5c5b2d45704d554c0d33fdcce1f43c508f1fb5c9539a8345999
Jul 28 01:12:16.970213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:16.970146    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:17.072374 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:17.072336    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:17.714244 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:17.714171    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n" event={"ID":"9371e3b4-8749-4120-91bd-d3be13cd4812","Type":"ContainerStarted","Data":"884ed36e3e8ab5c5b2d45704d554c0d33fdcce1f43c508f1fb5c9539a8345999"}
Jul 28 01:12:20.730463 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:20.730430    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n" event={"ID":"9371e3b4-8749-4120-91bd-d3be13cd4812","Type":"ContainerStarted","Data":"5e6edd25ca45db365934350d8f29a1830d65e2bf1dca884eb488d8dbe6bbdb75"}
Jul 28 01:12:21.736248 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:21.736215    2552 generic.go:356] "Generic (PLEG): container finished" podID="9371e3b4-8749-4120-91bd-d3be13cd4812" containerID="5e6edd25ca45db365934350d8f29a1830d65e2bf1dca884eb488d8dbe6bbdb75" exitCode=0
Jul 28 01:12:21.736673 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:21.736305    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n" event={"ID":"9371e3b4-8749-4120-91bd-d3be13cd4812","Type":"ContainerDied","Data":"5e6edd25ca45db365934350d8f29a1830d65e2bf1dca884eb488d8dbe6bbdb75"}
Jul 28 01:12:22.742653 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:22.742620    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n" event={"ID":"9371e3b4-8749-4120-91bd-d3be13cd4812","Type":"ContainerStarted","Data":"bab231a047d79eeff709878ab7444ff63ad5c1dd2d427d4d31c646f2852e97e4"}
Jul 28 01:12:22.743057 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:22.742727    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:22.764972 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:22.764916    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n" podStartSLOduration=2.469476539 podStartE2EDuration="6.764895172s" totalImagesPullingTime="3.298586128s" totalInitContainerRuntime="996.832505ms" isStatefulPod=false podCreationTimestamp="2026-07-28 01:12:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:12:22.763466106 +0000 UTC m=+475.377774198" watchObservedRunningTime="2026-07-28 01:12:22.764895172 +0000 UTC m=+475.379203222"
Jul 28 01:12:27.681892 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:27.681859    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:27.776213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:27.776175    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:33.749502 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:33.749474    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n"
Jul 28 01:12:45.940155 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:45.940102    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:46.042274 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.042242    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:46.250283 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.250194    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:46.348641 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.348601    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"]
Jul 28 01:12:46.351741 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.351714    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:46.358422 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.358400    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.361499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.361474    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 01:12:46.362314 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.362291    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 28 01:12:46.362314 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.362312    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"]
Jul 28 01:12:46.362473 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.362295    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lspb9\""
Jul 28 01:12:46.362473 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.362298    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 28 01:12:46.362634 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.362618    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 01:12:46.452931 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.452894    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee9d9343-b2d2-4d42-a76f-a8093adb4dba-tmp\") pod \"kube-auth-proxy-5f6ffdb965-ld6k8\" (UID: \"ee9d9343-b2d2-4d42-a76f-a8093adb4dba\") " pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.452931 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.452934    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkl68\" (UniqueName: \"kubernetes.io/projected/ee9d9343-b2d2-4d42-a76f-a8093adb4dba-kube-api-access-kkl68\") pod \"kube-auth-proxy-5f6ffdb965-ld6k8\" (UID: \"ee9d9343-b2d2-4d42-a76f-a8093adb4dba\") " pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.453201 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.453018    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9d9343-b2d2-4d42-a76f-a8093adb4dba-tls-certs\") pod \"kube-auth-proxy-5f6ffdb965-ld6k8\" (UID: \"ee9d9343-b2d2-4d42-a76f-a8093adb4dba\") " pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.554384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.554293    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee9d9343-b2d2-4d42-a76f-a8093adb4dba-tmp\") pod \"kube-auth-proxy-5f6ffdb965-ld6k8\" (UID: \"ee9d9343-b2d2-4d42-a76f-a8093adb4dba\") " pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.554384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.554327    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkl68\" (UniqueName: \"kubernetes.io/projected/ee9d9343-b2d2-4d42-a76f-a8093adb4dba-kube-api-access-kkl68\") pod \"kube-auth-proxy-5f6ffdb965-ld6k8\" (UID: \"ee9d9343-b2d2-4d42-a76f-a8093adb4dba\") " pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.554384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.554381    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9d9343-b2d2-4d42-a76f-a8093adb4dba-tls-certs\") pod \"kube-auth-proxy-5f6ffdb965-ld6k8\" (UID: \"ee9d9343-b2d2-4d42-a76f-a8093adb4dba\") " pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.556707 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.556675    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee9d9343-b2d2-4d42-a76f-a8093adb4dba-tmp\") pod \"kube-auth-proxy-5f6ffdb965-ld6k8\" (UID: \"ee9d9343-b2d2-4d42-a76f-a8093adb4dba\") " pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.557000 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.556980    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee9d9343-b2d2-4d42-a76f-a8093adb4dba-tls-certs\") pod \"kube-auth-proxy-5f6ffdb965-ld6k8\" (UID: \"ee9d9343-b2d2-4d42-a76f-a8093adb4dba\") " pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.572698 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.572671    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkl68\" (UniqueName: \"kubernetes.io/projected/ee9d9343-b2d2-4d42-a76f-a8093adb4dba-kube-api-access-kkl68\") pod \"kube-auth-proxy-5f6ffdb965-ld6k8\" (UID: \"ee9d9343-b2d2-4d42-a76f-a8093adb4dba\") " pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.597310 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.597285    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8tnkc"]
Jul 28 01:12:46.604369 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.604339    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:12:46.607045 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.607025    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-8lt4x\""
Jul 28 01:12:46.607171 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.607025    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 28 01:12:46.621887 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.621860    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8tnkc"]
Jul 28 01:12:46.634891 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.634861    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:46.668971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.668944    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"
Jul 28 01:12:46.732608 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.732569    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:46.755897 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.755520    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad44e239-4ad8-4187-9b57-0265a0b1b75f-cert\") pod \"odh-model-controller-7998c67dc4-8tnkc\" (UID: \"ad44e239-4ad8-4187-9b57-0265a0b1b75f\") " pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:12:46.755897 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.755560    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txfpq\" (UniqueName: \"kubernetes.io/projected/ad44e239-4ad8-4187-9b57-0265a0b1b75f-kube-api-access-txfpq\") pod \"odh-model-controller-7998c67dc4-8tnkc\" (UID: \"ad44e239-4ad8-4187-9b57-0265a0b1b75f\") " pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:12:46.804678 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.804614    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8"]
Jul 28 01:12:46.807185 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:12:46.807159    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9d9343_b2d2_4d42_a76f_a8093adb4dba.slice/crio-4f5a7159e1b21fbc0708ce84c2d6e87940532997ca3a1da62a40bf0acab94cf0 WatchSource:0}: Error finding container 4f5a7159e1b21fbc0708ce84c2d6e87940532997ca3a1da62a40bf0acab94cf0: Status 404 returned error can't find the container with id 4f5a7159e1b21fbc0708ce84c2d6e87940532997ca3a1da62a40bf0acab94cf0
Jul 28 01:12:46.807332 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.807315    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:46.845503 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.845470    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8" event={"ID":"ee9d9343-b2d2-4d42-a76f-a8093adb4dba","Type":"ContainerStarted","Data":"4f5a7159e1b21fbc0708ce84c2d6e87940532997ca3a1da62a40bf0acab94cf0"}
Jul 28 01:12:46.856950 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.856923    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad44e239-4ad8-4187-9b57-0265a0b1b75f-cert\") pod \"odh-model-controller-7998c67dc4-8tnkc\" (UID: \"ad44e239-4ad8-4187-9b57-0265a0b1b75f\") " pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:12:46.857025 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.856960    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txfpq\" (UniqueName: \"kubernetes.io/projected/ad44e239-4ad8-4187-9b57-0265a0b1b75f-kube-api-access-txfpq\") pod \"odh-model-controller-7998c67dc4-8tnkc\" (UID: \"ad44e239-4ad8-4187-9b57-0265a0b1b75f\") " pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:12:46.857122 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:12:46.857106    2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 28 01:12:46.857227 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:12:46.857216    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad44e239-4ad8-4187-9b57-0265a0b1b75f-cert podName:ad44e239-4ad8-4187-9b57-0265a0b1b75f nodeName:}" failed. No retries permitted until 2026-07-28 01:12:47.357199202 +0000 UTC m=+499.971507251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ad44e239-4ad8-4187-9b57-0265a0b1b75f-cert") pod "odh-model-controller-7998c67dc4-8tnkc" (UID: "ad44e239-4ad8-4187-9b57-0265a0b1b75f") : secret "odh-model-controller-webhook-cert" not found
Jul 28 01:12:46.867278 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:46.867257    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txfpq\" (UniqueName: \"kubernetes.io/projected/ad44e239-4ad8-4187-9b57-0265a0b1b75f-kube-api-access-txfpq\") pod \"odh-model-controller-7998c67dc4-8tnkc\" (UID: \"ad44e239-4ad8-4187-9b57-0265a0b1b75f\") " pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:12:47.034630 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.034593    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:47.361204 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.361165    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad44e239-4ad8-4187-9b57-0265a0b1b75f-cert\") pod \"odh-model-controller-7998c67dc4-8tnkc\" (UID: \"ad44e239-4ad8-4187-9b57-0265a0b1b75f\") " pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:12:47.363714 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.363694    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad44e239-4ad8-4187-9b57-0265a0b1b75f-cert\") pod \"odh-model-controller-7998c67dc4-8tnkc\" (UID: \"ad44e239-4ad8-4187-9b57-0265a0b1b75f\") " pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:12:47.373253 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.373215    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:47.444310 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.444277    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9hhzc"]
Jul 28 01:12:47.447899 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.447874    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:12:47.450421 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.450390    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 28 01:12:47.450421 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.450411    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wxvrz\""
Jul 28 01:12:47.457944 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.457899    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9hhzc"]
Jul 28 01:12:47.514543 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.514511    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:12:47.538462 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.538432    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:47.548899 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.548854    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"]
Jul 28 01:12:47.553109 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.553080    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.556213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.555940    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 28 01:12:47.556213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.555954    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 01:12:47.556213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.556014    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 28 01:12:47.556213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.556027    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 28 01:12:47.556213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.556076    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m4x25\""
Jul 28 01:12:47.563430 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.563274    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a8aa6a-e4c4-4b95-9c5b-f77e15107c21-tls-certs\") pod \"model-serving-api-54d89bd5fc-9hhzc\" (UID: \"46a8aa6a-e4c4-4b95-9c5b-f77e15107c21\") " pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:12:47.563430 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.563324    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcbvw\" (UniqueName: \"kubernetes.io/projected/46a8aa6a-e4c4-4b95-9c5b-f77e15107c21-kube-api-access-fcbvw\") pod \"model-serving-api-54d89bd5fc-9hhzc\" (UID: \"46a8aa6a-e4c4-4b95-9c5b-f77e15107c21\") " pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:12:47.565915 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.565807    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"]
Jul 28 01:12:47.608011 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.607979    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:47.664891 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.664843    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh4d7\" (UniqueName: \"kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-kube-api-access-fh4d7\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.665063 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.664920    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a8aa6a-e4c4-4b95-9c5b-f77e15107c21-tls-certs\") pod \"model-serving-api-54d89bd5fc-9hhzc\" (UID: \"46a8aa6a-e4c4-4b95-9c5b-f77e15107c21\") " pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:12:47.665063 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.664964    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcbvw\" (UniqueName: \"kubernetes.io/projected/46a8aa6a-e4c4-4b95-9c5b-f77e15107c21-kube-api-access-fcbvw\") pod \"model-serving-api-54d89bd5fc-9hhzc\" (UID: \"46a8aa6a-e4c4-4b95-9c5b-f77e15107c21\") " pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:12:47.665063 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.665006    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e69c2ebc-8f14-44aa-9858-db03aaf079fa-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.665063 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.665039    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.665334 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.665101    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.665334 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.665147    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.665334 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.665176    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.665334 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.665201    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.665525 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:12:47.665409    2552 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 28 01:12:47.665525 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:12:47.665479    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46a8aa6a-e4c4-4b95-9c5b-f77e15107c21-tls-certs podName:46a8aa6a-e4c4-4b95-9c5b-f77e15107c21 nodeName:}" failed. No retries permitted until 2026-07-28 01:12:48.165457898 +0000 UTC m=+500.779765953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/46a8aa6a-e4c4-4b95-9c5b-f77e15107c21-tls-certs") pod "model-serving-api-54d89bd5fc-9hhzc" (UID: "46a8aa6a-e4c4-4b95-9c5b-f77e15107c21") : secret "model-serving-api-tls" not found
Jul 28 01:12:47.675294 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.675260    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcbvw\" (UniqueName: \"kubernetes.io/projected/46a8aa6a-e4c4-4b95-9c5b-f77e15107c21-kube-api-access-fcbvw\") pod \"model-serving-api-54d89bd5fc-9hhzc\" (UID: \"46a8aa6a-e4c4-4b95-9c5b-f77e15107c21\") " pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:12:47.703647 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.703593    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-8tnkc"]
Jul 28 01:12:47.706177 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:12:47.706093    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad44e239_4ad8_4187_9b57_0265a0b1b75f.slice/crio-70a4738d086ea1fa7c73b69d49fbd1b28a8cb15cfebb8191da031d961adbf4ae WatchSource:0}: Error finding container 70a4738d086ea1fa7c73b69d49fbd1b28a8cb15cfebb8191da031d961adbf4ae: Status 404 returned error can't find the container with id 70a4738d086ea1fa7c73b69d49fbd1b28a8cb15cfebb8191da031d961adbf4ae
Jul 28 01:12:47.765763 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.765731    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e69c2ebc-8f14-44aa-9858-db03aaf079fa-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.766008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.765781    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.766008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.765825    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.766008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.765852    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.766008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.765877    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.766008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.765902    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.766008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.765941    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh4d7\" (UniqueName: \"kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-kube-api-access-fh4d7\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.767083 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.767044    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.768753 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.768724    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.768971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.768933    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e69c2ebc-8f14-44aa-9858-db03aaf079fa-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.769167 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.769125    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.769504 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.769483    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.774195 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.774175    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh4d7\" (UniqueName: \"kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-kube-api-access-fh4d7\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.774340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.774319    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bpkvk\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:47.851813 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.851773    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc" event={"ID":"ad44e239-4ad8-4187-9b57-0265a0b1b75f","Type":"ContainerStarted","Data":"70a4738d086ea1fa7c73b69d49fbd1b28a8cb15cfebb8191da031d961adbf4ae"}
Jul 28 01:12:47.864496 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.864442    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:47.879656 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:47.879629    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:48.029372 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:48.029342    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"]
Jul 28 01:12:48.032742 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:12:48.032700    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode69c2ebc_8f14_44aa_9858_db03aaf079fa.slice/crio-439b276c38c765b8d86981721c930abc8bc2a3e57b5faff3e6dc9f15ef0cbc79 WatchSource:0}: Error finding container 439b276c38c765b8d86981721c930abc8bc2a3e57b5faff3e6dc9f15ef0cbc79: Status 404 returned error can't find the container with id 439b276c38c765b8d86981721c930abc8bc2a3e57b5faff3e6dc9f15ef0cbc79
Jul 28 01:12:48.169693 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:48.169598    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a8aa6a-e4c4-4b95-9c5b-f77e15107c21-tls-certs\") pod \"model-serving-api-54d89bd5fc-9hhzc\" (UID: \"46a8aa6a-e4c4-4b95-9c5b-f77e15107c21\") " pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:12:48.172109 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:48.172088    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46a8aa6a-e4c4-4b95-9c5b-f77e15107c21-tls-certs\") pod \"model-serving-api-54d89bd5fc-9hhzc\" (UID: \"46a8aa6a-e4c4-4b95-9c5b-f77e15107c21\") " pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:12:48.363050 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:48.363013    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:12:48.418108 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:48.418080    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:48.525363 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:48.525333    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-9hhzc"]
Jul 28 01:12:48.527166 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:12:48.527115    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a8aa6a_e4c4_4b95_9c5b_f77e15107c21.slice/crio-d9fff9a15218fadf9638a8ef795e4fcfa9b9f1c65d2fb2796d6fb81ddaa31a16 WatchSource:0}: Error finding container d9fff9a15218fadf9638a8ef795e4fcfa9b9f1c65d2fb2796d6fb81ddaa31a16: Status 404 returned error can't find the container with id d9fff9a15218fadf9638a8ef795e4fcfa9b9f1c65d2fb2796d6fb81ddaa31a16
Jul 28 01:12:48.861983 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:48.861897    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc" event={"ID":"46a8aa6a-e4c4-4b95-9c5b-f77e15107c21","Type":"ContainerStarted","Data":"d9fff9a15218fadf9638a8ef795e4fcfa9b9f1c65d2fb2796d6fb81ddaa31a16"}
Jul 28 01:12:48.865370 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:48.865335    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk" event={"ID":"e69c2ebc-8f14-44aa-9858-db03aaf079fa","Type":"ContainerStarted","Data":"439b276c38c765b8d86981721c930abc8bc2a3e57b5faff3e6dc9f15ef0cbc79"}
Jul 28 01:12:52.544222 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.544170    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:12:52.544580 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.544273    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:12:52.890847 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.890813    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8" event={"ID":"ee9d9343-b2d2-4d42-a76f-a8093adb4dba","Type":"ContainerStarted","Data":"aa84a0f5a72ff5167257ab8f6768e14d8e75b80f93b87bed22da6fcb1afdc4cb"}
Jul 28 01:12:52.892502 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.892468    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc" event={"ID":"ad44e239-4ad8-4187-9b57-0265a0b1b75f","Type":"ContainerStarted","Data":"c055606e46f3d81da4cdfac8456ec1cee3b9a389ed9aefaa9c12a660d9bdeaeb"}
Jul 28 01:12:52.892629 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.892535    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:12:52.894052 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.894024    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc" event={"ID":"46a8aa6a-e4c4-4b95-9c5b-f77e15107c21","Type":"ContainerStarted","Data":"3834b243c5975fd0c1c5a13876224b75bf8003ab28cfdbe68357367a5d074b53"}
Jul 28 01:12:52.894190 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.894153    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:12:52.895645 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.895622    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk" event={"ID":"e69c2ebc-8f14-44aa-9858-db03aaf079fa","Type":"ContainerStarted","Data":"267eb7733c72eb9931928909b3a477955afd0d70c30ae456889e0d4c2299184b"}
Jul 28 01:12:52.895755 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.895744    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:52.906325 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.906277    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f6ffdb965-ld6k8" podStartSLOduration=1.182703986 podStartE2EDuration="6.906261419s" totalImagesPullingTime="5.723557433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:12:52.906058569 +0000 UTC m=+505.520366654" watchObservedRunningTime="2026-07-28 01:12:52.906261419 +0000 UTC m=+505.520569491"
Jul 28 01:12:52.925438 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.925371    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk" podStartSLOduration=1.41683707 podStartE2EDuration="5.9253494s" totalImagesPullingTime="4.50851233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:12:52.923947393 +0000 UTC m=+505.538255466" watchObservedRunningTime="2026-07-28 01:12:52.9253494 +0000 UTC m=+505.539657470"
Jul 28 01:12:52.945019 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.944959    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc" podStartSLOduration=2.109417835 podStartE2EDuration="6.944941393s" totalImagesPullingTime="4.835523558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:12:52.943636336 +0000 UTC m=+505.557944409" watchObservedRunningTime="2026-07-28 01:12:52.944941393 +0000 UTC m=+505.559249464"
Jul 28 01:12:52.963736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:52.963664    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc" podStartSLOduration=1.945939474 podStartE2EDuration="5.963641793s" totalImagesPullingTime="4.017702319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:12:52.962313589 +0000 UTC m=+505.576621653" watchObservedRunningTime="2026-07-28 01:12:52.963641793 +0000 UTC m=+505.577949868"
Jul 28 01:12:53.493318 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:53.493272    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:53.631273 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:53.631239    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:53.901622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:53.901593    2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-bpkvk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 01:12:53.901773 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:53.901642    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk" podUID="e69c2ebc-8f14-44aa-9858-db03aaf079fa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:12:54.148508 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.148475    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"]
Jul 28 01:12:54.154371 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.154315    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.156818 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.156800    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tf5v5\""
Jul 28 01:12:54.161937 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.161915    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"]
Jul 28 01:12:54.179522 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.179500    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:54.221844 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.221812    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.221991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.221853    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.221991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.221875    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.221991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.221913    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.221991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.221971    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.221991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.221989    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.222195 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.222010    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhpdn\" (UniqueName: \"kubernetes.io/projected/557b37fe-41fc-4ad6-a4ad-c24b1856986d-kube-api-access-zhpdn\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.222195 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.222038    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.222195 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.222100    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323016 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.322980    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323016 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323016    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323263 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323040    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323263 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323058    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323263 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323077    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhpdn\" (UniqueName: \"kubernetes.io/projected/557b37fe-41fc-4ad6-a4ad-c24b1856986d-kube-api-access-zhpdn\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323263 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323187    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323263 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323229    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323512 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323303    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323512 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323347    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323620 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323511    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323620 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323554    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323714 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323632    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323761 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323731    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.323893 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.323872    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.325821 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.325794    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.326007 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.325983    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.336651 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.336628    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhpdn\" (UniqueName: \"kubernetes.io/projected/557b37fe-41fc-4ad6-a4ad-c24b1856986d-kube-api-access-zhpdn\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.336996 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.336976    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557b37fe-41fc-4ad6-a4ad-c24b1856986d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh\" (UID: \"557b37fe-41fc-4ad6-a4ad-c24b1856986d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.465733 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.465658    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:54.502265 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.502234    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:54.585554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.585513    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:54.604221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.604197    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"]
Jul 28 01:12:54.606460 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:12:54.606434    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557b37fe_41fc_4ad6_a4ad_c24b1856986d.slice/crio-68f6d2e3a23cfa9ebb51729aa3354bbb18e2f6fce60a07d350f16d1bd75156fa WatchSource:0}: Error finding container 68f6d2e3a23cfa9ebb51729aa3354bbb18e2f6fce60a07d350f16d1bd75156fa: Status 404 returned error can't find the container with id 68f6d2e3a23cfa9ebb51729aa3354bbb18e2f6fce60a07d350f16d1bd75156fa
Jul 28 01:12:54.905609 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:54.905573    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh" event={"ID":"557b37fe-41fc-4ad6-a4ad-c24b1856986d","Type":"ContainerStarted","Data":"68f6d2e3a23cfa9ebb51729aa3354bbb18e2f6fce60a07d350f16d1bd75156fa"}
Jul 28 01:12:56.544305 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.544234    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:56.596007 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.595959    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"]
Jul 28 01:12:56.602197 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.600112    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"
Jul 28 01:12:56.603824 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.603797    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 28 01:12:56.604080 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.603912    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8jkt8\""
Jul 28 01:12:56.610862 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.610818    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"]
Jul 28 01:12:56.613603 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.613570    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:12:56.616538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.616511    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 28 01:12:56.616751 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.616722    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"]
Jul 28 01:12:56.616836 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.616813    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lfz2v\""
Jul 28 01:12:56.635755 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.635707    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"]
Jul 28 01:12:56.644858 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.644829    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcnq7\" (UniqueName: \"kubernetes.io/projected/e0d3aa61-9015-49b0-bf02-f996f1d58b7c-kube-api-access-rcnq7\") pod \"kserve-controller-manager-d6f4b65b8-dkqzc\" (UID: \"e0d3aa61-9015-49b0-bf02-f996f1d58b7c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"
Jul 28 01:12:56.645012 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.644865    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/841cc1e8-49b1-416a-8f74-ee981f908cff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mtjx9\" (UID: \"841cc1e8-49b1-416a-8f74-ee981f908cff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:12:56.645012 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.644984    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0d3aa61-9015-49b0-bf02-f996f1d58b7c-cert\") pod \"kserve-controller-manager-d6f4b65b8-dkqzc\" (UID: \"e0d3aa61-9015-49b0-bf02-f996f1d58b7c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"
Jul 28 01:12:56.645148 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.645032    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89rgv\" (UniqueName: \"kubernetes.io/projected/841cc1e8-49b1-416a-8f74-ee981f908cff-kube-api-access-89rgv\") pod \"llmisvc-controller-manager-777c6bd7d5-mtjx9\" (UID: \"841cc1e8-49b1-416a-8f74-ee981f908cff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:12:56.647364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.647334    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:56.743212 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.743172    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:56.745592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.745562    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcnq7\" (UniqueName: \"kubernetes.io/projected/e0d3aa61-9015-49b0-bf02-f996f1d58b7c-kube-api-access-rcnq7\") pod \"kserve-controller-manager-d6f4b65b8-dkqzc\" (UID: \"e0d3aa61-9015-49b0-bf02-f996f1d58b7c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"
Jul 28 01:12:56.745592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.745599    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/841cc1e8-49b1-416a-8f74-ee981f908cff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mtjx9\" (UID: \"841cc1e8-49b1-416a-8f74-ee981f908cff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:12:56.745811 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.745660    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0d3aa61-9015-49b0-bf02-f996f1d58b7c-cert\") pod \"kserve-controller-manager-d6f4b65b8-dkqzc\" (UID: \"e0d3aa61-9015-49b0-bf02-f996f1d58b7c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"
Jul 28 01:12:56.745811 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.745696    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89rgv\" (UniqueName: \"kubernetes.io/projected/841cc1e8-49b1-416a-8f74-ee981f908cff-kube-api-access-89rgv\") pod \"llmisvc-controller-manager-777c6bd7d5-mtjx9\" (UID: \"841cc1e8-49b1-416a-8f74-ee981f908cff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:12:56.745913 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:12:56.745844    2552 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 28 01:12:56.745967 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:12:56.745914    2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841cc1e8-49b1-416a-8f74-ee981f908cff-cert podName:841cc1e8-49b1-416a-8f74-ee981f908cff nodeName:}" failed. No retries permitted until 2026-07-28 01:12:57.245895806 +0000 UTC m=+509.860203870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/841cc1e8-49b1-416a-8f74-ee981f908cff-cert") pod "llmisvc-controller-manager-777c6bd7d5-mtjx9" (UID: "841cc1e8-49b1-416a-8f74-ee981f908cff") : secret "llmisvc-webhook-server-cert" not found
Jul 28 01:12:56.748877 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.748842    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e0d3aa61-9015-49b0-bf02-f996f1d58b7c-cert\") pod \"kserve-controller-manager-d6f4b65b8-dkqzc\" (UID: \"e0d3aa61-9015-49b0-bf02-f996f1d58b7c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"
Jul 28 01:12:56.755284 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.755256    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcnq7\" (UniqueName: \"kubernetes.io/projected/e0d3aa61-9015-49b0-bf02-f996f1d58b7c-kube-api-access-rcnq7\") pod \"kserve-controller-manager-d6f4b65b8-dkqzc\" (UID: \"e0d3aa61-9015-49b0-bf02-f996f1d58b7c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"
Jul 28 01:12:56.755442 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.755388    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89rgv\" (UniqueName: \"kubernetes.io/projected/841cc1e8-49b1-416a-8f74-ee981f908cff-kube-api-access-89rgv\") pod \"llmisvc-controller-manager-777c6bd7d5-mtjx9\" (UID: \"841cc1e8-49b1-416a-8f74-ee981f908cff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:12:56.900801 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.900769    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:56.913568 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:56.913536    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"
Jul 28 01:12:57.120507 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.120462    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:57.250411 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.250319    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/841cc1e8-49b1-416a-8f74-ee981f908cff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mtjx9\" (UID: \"841cc1e8-49b1-416a-8f74-ee981f908cff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:12:57.253262 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.253230    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/841cc1e8-49b1-416a-8f74-ee981f908cff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mtjx9\" (UID: \"841cc1e8-49b1-416a-8f74-ee981f908cff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:12:57.527013 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.526917    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:12:57.723005 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.722964    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:12:57.723386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.723057    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:12:57.723386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.723096    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:12:57.830802 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.830769    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"]
Jul 28 01:12:57.832276 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.832250    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:57.851471 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.851447    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"]
Jul 28 01:12:57.853776 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:12:57.853743    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d3aa61_9015_49b0_bf02_f996f1d58b7c.slice/crio-92bd2642eaf87a8f93360c90e0e0e766669f36d353440a202e750e9a92059647 WatchSource:0}: Error finding container 92bd2642eaf87a8f93360c90e0e0e766669f36d353440a202e750e9a92059647: Status 404 returned error can't find the container with id 92bd2642eaf87a8f93360c90e0e0e766669f36d353440a202e750e9a92059647
Jul 28 01:12:57.923599 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.923567    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc" event={"ID":"e0d3aa61-9015-49b0-bf02-f996f1d58b7c","Type":"ContainerStarted","Data":"92bd2642eaf87a8f93360c90e0e0e766669f36d353440a202e750e9a92059647"}
Jul 28 01:12:57.925399 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.925364    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh" event={"ID":"557b37fe-41fc-4ad6-a4ad-c24b1856986d","Type":"ContainerStarted","Data":"cc744c7b5db2396509baf27271fccde153bb742f69e0b5d33a9e9eeb6c2a400d"}
Jul 28 01:12:57.926686 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.926663    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9" event={"ID":"841cc1e8-49b1-416a-8f74-ee981f908cff","Type":"ContainerStarted","Data":"5f838631b0435bceebc54260de93350305e97c1664025540c426d2667d81689a"}
Jul 28 01:12:57.951168 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.951126    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:57.960269 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:57.960233    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh" podStartSLOduration=0.845775001 podStartE2EDuration="3.96021802s" totalImagesPullingTime="3.114443019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:12:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:12:57.958955627 +0000 UTC m=+510.573263700" watchObservedRunningTime="2026-07-28 01:12:57.96021802 +0000 UTC m=+510.574526092"
Jul 28 01:12:58.215246 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:58.215211    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:12:58.466878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:58.466794    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:58.468179 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:58.468152    2552 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Jul 28 01:12:58.468327 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:58.468203    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh" podUID="557b37fe-41fc-4ad6-a4ad-c24b1856986d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Jul 28 01:12:58.723247 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:58.723167    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"]
Jul 28 01:12:58.723721 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:58.723358    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk" podUID="e69c2ebc-8f14-44aa-9858-db03aaf079fa" containerName="discovery" containerID="cri-o://267eb7733c72eb9931928909b3a477955afd0d70c30ae456889e0d4c2299184b" gracePeriod=30
Jul 28 01:12:58.935545 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:58.935506    2552 generic.go:356] "Generic (PLEG): container finished" podID="e69c2ebc-8f14-44aa-9858-db03aaf079fa" containerID="267eb7733c72eb9931928909b3a477955afd0d70c30ae456889e0d4c2299184b" exitCode=0
Jul 28 01:12:58.935855 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:58.935828    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk" event={"ID":"e69c2ebc-8f14-44aa-9858-db03aaf079fa","Type":"ContainerDied","Data":"267eb7733c72eb9931928909b3a477955afd0d70c30ae456889e0d4c2299184b"}
Jul 28 01:12:59.143969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.143938    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:59.169218 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.169189    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-ca-configmap\") pod \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") "
Jul 28 01:12:59.169430 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.169234    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-token\") pod \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") "
Jul 28 01:12:59.169430 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.169281    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh4d7\" (UniqueName: \"kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-kube-api-access-fh4d7\") pod \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") "
Jul 28 01:12:59.169430 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.169352    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-cacerts\") pod \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") "
Jul 28 01:12:59.169430 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.169389    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e69c2ebc-8f14-44aa-9858-db03aaf079fa-local-certs\") pod \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") "
Jul 28 01:12:59.169629 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.169433    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-dns-cert\") pod \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") "
Jul 28 01:12:59.169629 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.169460    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-kubeconfig\") pod \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\" (UID: \"e69c2ebc-8f14-44aa-9858-db03aaf079fa\") "
Jul 28 01:12:59.170115 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.169883    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e69c2ebc-8f14-44aa-9858-db03aaf079fa" (UID: "e69c2ebc-8f14-44aa-9858-db03aaf079fa"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:12:59.173057 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.172993    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-cacerts" (OuterVolumeSpecName: "cacerts") pod "e69c2ebc-8f14-44aa-9858-db03aaf079fa" (UID: "e69c2ebc-8f14-44aa-9858-db03aaf079fa"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:12:59.174056 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.174027    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e69c2ebc-8f14-44aa-9858-db03aaf079fa" (UID: "e69c2ebc-8f14-44aa-9858-db03aaf079fa"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:12:59.174453 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.174404    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e69c2ebc-8f14-44aa-9858-db03aaf079fa" (UID: "e69c2ebc-8f14-44aa-9858-db03aaf079fa"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:12:59.174453 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.174408    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "e69c2ebc-8f14-44aa-9858-db03aaf079fa" (UID: "e69c2ebc-8f14-44aa-9858-db03aaf079fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:12:59.175033 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.174945    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e69c2ebc-8f14-44aa-9858-db03aaf079fa-local-certs" (OuterVolumeSpecName: "local-certs") pod "e69c2ebc-8f14-44aa-9858-db03aaf079fa" (UID: "e69c2ebc-8f14-44aa-9858-db03aaf079fa"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:12:59.175033 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.174997    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-kube-api-access-fh4d7" (OuterVolumeSpecName: "kube-api-access-fh4d7") pod "e69c2ebc-8f14-44aa-9858-db03aaf079fa" (UID: "e69c2ebc-8f14-44aa-9858-db03aaf079fa"). InnerVolumeSpecName "kube-api-access-fh4d7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:12:59.270743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.270705    2552 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-cacerts\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:12:59.270743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.270740    2552 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e69c2ebc-8f14-44aa-9858-db03aaf079fa-local-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:12:59.270974 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.270756    2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-dns-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:12:59.270974 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.270768    2552 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-kubeconfig\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:12:59.270974 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.270780    2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-csr-ca-configmap\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:12:59.270974 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.270792    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:12:59.270974 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.270803    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh4d7\" (UniqueName: \"kubernetes.io/projected/e69c2ebc-8f14-44aa-9858-db03aaf079fa-kube-api-access-fh4d7\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:12:59.469811 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.469773    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:59.943034 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.942778    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk" event={"ID":"e69c2ebc-8f14-44aa-9858-db03aaf079fa","Type":"ContainerDied","Data":"439b276c38c765b8d86981721c930abc8bc2a3e57b5faff3e6dc9f15ef0cbc79"}
Jul 28 01:12:59.943034 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.942809    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"
Jul 28 01:12:59.943034 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.942856    2552 scope.go:117] "RemoveContainer" containerID="267eb7733c72eb9931928909b3a477955afd0d70c30ae456889e0d4c2299184b"
Jul 28 01:12:59.943034 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.942994    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:59.944880 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.944857    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh"
Jul 28 01:12:59.980781 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.980751    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"]
Jul 28 01:12:59.984030 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:12:59.984002    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bpkvk"]
Jul 28 01:13:00.023236 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:00.023115    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e69c2ebc-8f14-44aa-9858-db03aaf079fa" path="/var/lib/kubelet/pods/e69c2ebc-8f14-44aa-9858-db03aaf079fa/volumes"
Jul 28 01:13:00.950833 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:00.950799    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc" event={"ID":"e0d3aa61-9015-49b0-bf02-f996f1d58b7c","Type":"ContainerStarted","Data":"1ffea86c49e5b50fb81807f9cd410d3ffde6a023be503412f2cd99891eb29d54"}
Jul 28 01:13:00.951343 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:00.951069    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"
Jul 28 01:13:00.967440 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:00.967391    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc" podStartSLOduration=1.9639306140000001 podStartE2EDuration="4.967374254s" totalImagesPullingTime="3.00344364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:13:00.965551351 +0000 UTC m=+513.579863946" watchObservedRunningTime="2026-07-28 01:13:00.967374254 +0000 UTC m=+513.581682327"
Jul 28 01:13:01.956632 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:01.956595    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9" event={"ID":"841cc1e8-49b1-416a-8f74-ee981f908cff","Type":"ContainerStarted","Data":"885fb817d26b18f77a59fdbe6478e4a7fd242cd2e9630ac1ff5406301ec5db00"}
Jul 28 01:13:01.957048 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:01.956805    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:13:01.976024 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:01.975973    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9" podStartSLOduration=2.947322035 podStartE2EDuration="5.975956803s" totalImagesPullingTime="3.028634768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:13:01.974289392 +0000 UTC m=+514.588597494" watchObservedRunningTime="2026-07-28 01:13:01.975956803 +0000 UTC m=+514.590264874"
Jul 28 01:13:03.902359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:03.902328    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-8tnkc"
Jul 28 01:13:03.905361 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:03.905342    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-9hhzc"
Jul 28 01:13:31.962435 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:31.962399    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dkqzc"
Jul 28 01:13:32.964057 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:32.964024    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mtjx9"
Jul 28 01:13:47.397045 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.397005    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:13:47.527365 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.527325    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxckg"]
Jul 28 01:13:47.527704 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.527687    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69c2ebc-8f14-44aa-9858-db03aaf079fa" containerName="discovery"
Jul 28 01:13:47.527704 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.527704    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69c2ebc-8f14-44aa-9858-db03aaf079fa" containerName="discovery"
Jul 28 01:13:47.527850 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.527774    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69c2ebc-8f14-44aa-9858-db03aaf079fa" containerName="discovery"
Jul 28 01:13:47.542121 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.542081    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxckg"]
Jul 28 01:13:47.542321 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.542229    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxckg"
Jul 28 01:13:47.544611 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.544590    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8nhdf\""
Jul 28 01:13:47.544996 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.544976    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 01:13:47.545577 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.545553    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 01:13:47.582217 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.582187    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wccsf\" (UniqueName: \"kubernetes.io/projected/3a542184-3473-4301-ab2d-cbde89dc4a58-kube-api-access-wccsf\") pod \"kuadrant-operator-catalog-wxckg\" (UID: \"3a542184-3473-4301-ab2d-cbde89dc4a58\") " pod="kuadrant-system/kuadrant-operator-catalog-wxckg"
Jul 28 01:13:47.683589 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.683490    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wccsf\" (UniqueName: \"kubernetes.io/projected/3a542184-3473-4301-ab2d-cbde89dc4a58-kube-api-access-wccsf\") pod \"kuadrant-operator-catalog-wxckg\" (UID: \"3a542184-3473-4301-ab2d-cbde89dc4a58\") " pod="kuadrant-system/kuadrant-operator-catalog-wxckg"
Jul 28 01:13:47.691093 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.691058    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wccsf\" (UniqueName: \"kubernetes.io/projected/3a542184-3473-4301-ab2d-cbde89dc4a58-kube-api-access-wccsf\") pod \"kuadrant-operator-catalog-wxckg\" (UID: \"3a542184-3473-4301-ab2d-cbde89dc4a58\") " pod="kuadrant-system/kuadrant-operator-catalog-wxckg"
Jul 28 01:13:47.851849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.851805    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxckg"
Jul 28 01:13:47.888369 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.888340    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxckg"]
Jul 28 01:13:47.977864 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:47.977839    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxckg"]
Jul 28 01:13:47.980308 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:13:47.980271    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a542184_3473_4301_ab2d_cbde89dc4a58.slice/crio-1c76cafd0284753089af1554842f92b6381cd1f74d4622301d1ebabcf1691223 WatchSource:0}: Error finding container 1c76cafd0284753089af1554842f92b6381cd1f74d4622301d1ebabcf1691223: Status 404 returned error can't find the container with id 1c76cafd0284753089af1554842f92b6381cd1f74d4622301d1ebabcf1691223
Jul 28 01:13:48.099000 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:48.098974    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2gcr9"]
Jul 28 01:13:48.101842 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:48.101826    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2gcr9"
Jul 28 01:13:48.109354 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:48.109321    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2gcr9"]
Jul 28 01:13:48.172321 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:48.172288    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxckg" event={"ID":"3a542184-3473-4301-ab2d-cbde89dc4a58","Type":"ContainerStarted","Data":"1c76cafd0284753089af1554842f92b6381cd1f74d4622301d1ebabcf1691223"}
Jul 28 01:13:48.187858 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:48.187833    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjr9c\" (UniqueName: \"kubernetes.io/projected/ea4b4654-54bd-4c8f-a59f-9660765e9438-kube-api-access-xjr9c\") pod \"kuadrant-operator-catalog-2gcr9\" (UID: \"ea4b4654-54bd-4c8f-a59f-9660765e9438\") " pod="kuadrant-system/kuadrant-operator-catalog-2gcr9"
Jul 28 01:13:48.289325 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:48.289241    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjr9c\" (UniqueName: \"kubernetes.io/projected/ea4b4654-54bd-4c8f-a59f-9660765e9438-kube-api-access-xjr9c\") pod \"kuadrant-operator-catalog-2gcr9\" (UID: \"ea4b4654-54bd-4c8f-a59f-9660765e9438\") " pod="kuadrant-system/kuadrant-operator-catalog-2gcr9"
Jul 28 01:13:48.296511 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:48.296476    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjr9c\" (UniqueName: \"kubernetes.io/projected/ea4b4654-54bd-4c8f-a59f-9660765e9438-kube-api-access-xjr9c\") pod \"kuadrant-operator-catalog-2gcr9\" (UID: \"ea4b4654-54bd-4c8f-a59f-9660765e9438\") " pod="kuadrant-system/kuadrant-operator-catalog-2gcr9"
Jul 28 01:13:48.411974 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:48.411943    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2gcr9"
Jul 28 01:13:48.606957 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:48.606382    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2gcr9"]
Jul 28 01:13:48.616105 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:13:48.616077    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4b4654_54bd_4c8f_a59f_9660765e9438.slice/crio-39e5c8a2e4a2f1e08dc2972c7a6be4f6bc6b705568e6a5d7b8a7c75b8d7f9afe WatchSource:0}: Error finding container 39e5c8a2e4a2f1e08dc2972c7a6be4f6bc6b705568e6a5d7b8a7c75b8d7f9afe: Status 404 returned error can't find the container with id 39e5c8a2e4a2f1e08dc2972c7a6be4f6bc6b705568e6a5d7b8a7c75b8d7f9afe
Jul 28 01:13:48.789851 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:48.789822    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:13:49.179288 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:49.179245    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2gcr9" event={"ID":"ea4b4654-54bd-4c8f-a59f-9660765e9438","Type":"ContainerStarted","Data":"39e5c8a2e4a2f1e08dc2972c7a6be4f6bc6b705568e6a5d7b8a7c75b8d7f9afe"}
Jul 28 01:13:50.185518 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:50.185478    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2gcr9" event={"ID":"ea4b4654-54bd-4c8f-a59f-9660765e9438","Type":"ContainerStarted","Data":"578699ba1d36188e8004831f09e4b6653967ceeb39c1d72deb6d255fbc2e8eb8"}
Jul 28 01:13:50.187017 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:50.186993    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxckg" event={"ID":"3a542184-3473-4301-ab2d-cbde89dc4a58","Type":"ContainerStarted","Data":"b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779"}
Jul 28 01:13:50.187173 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:50.187087    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wxckg" podUID="3a542184-3473-4301-ab2d-cbde89dc4a58" containerName="registry-server" containerID="cri-o://b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779" gracePeriod=2
Jul 28 01:13:50.200156 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:50.200094    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2gcr9" podStartSLOduration=1.069529435 podStartE2EDuration="2.200078479s" totalImagesPullingTime="1.130549044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:13:50.198736074 +0000 UTC m=+562.813044146" watchObservedRunningTime="2026-07-28 01:13:50.200078479 +0000 UTC m=+562.814386603"
Jul 28 01:13:50.213515 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:50.213474    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wxckg" podStartSLOduration=1.448007181 podStartE2EDuration="3.213458591s" totalImagesPullingTime="1.76545141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:13:50.212248447 +0000 UTC m=+562.826556530" watchObservedRunningTime="2026-07-28 01:13:50.213458591 +0000 UTC m=+562.827766663"
Jul 28 01:13:50.435889 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:50.435823    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxckg"
Jul 28 01:13:50.508850 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:50.508816    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wccsf\" (UniqueName: \"kubernetes.io/projected/3a542184-3473-4301-ab2d-cbde89dc4a58-kube-api-access-wccsf\") pod \"3a542184-3473-4301-ab2d-cbde89dc4a58\" (UID: \"3a542184-3473-4301-ab2d-cbde89dc4a58\") "
Jul 28 01:13:50.511025 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:50.511002    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a542184-3473-4301-ab2d-cbde89dc4a58-kube-api-access-wccsf" (OuterVolumeSpecName: "kube-api-access-wccsf") pod "3a542184-3473-4301-ab2d-cbde89dc4a58" (UID: "3a542184-3473-4301-ab2d-cbde89dc4a58"). InnerVolumeSpecName "kube-api-access-wccsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:13:50.610280 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:50.610238    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wccsf\" (UniqueName: \"kubernetes.io/projected/3a542184-3473-4301-ab2d-cbde89dc4a58-kube-api-access-wccsf\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:13:51.192986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:51.192947    2552 generic.go:356] "Generic (PLEG): container finished" podID="3a542184-3473-4301-ab2d-cbde89dc4a58" containerID="b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779" exitCode=0
Jul 28 01:13:51.193415 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:51.192994    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxckg"
Jul 28 01:13:51.193415 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:51.193035    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxckg" event={"ID":"3a542184-3473-4301-ab2d-cbde89dc4a58","Type":"ContainerDied","Data":"b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779"}
Jul 28 01:13:51.193415 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:51.193086    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxckg" event={"ID":"3a542184-3473-4301-ab2d-cbde89dc4a58","Type":"ContainerDied","Data":"1c76cafd0284753089af1554842f92b6381cd1f74d4622301d1ebabcf1691223"}
Jul 28 01:13:51.193415 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:51.193112    2552 scope.go:117] "RemoveContainer" containerID="b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779"
Jul 28 01:13:51.202532 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:51.202513    2552 scope.go:117] "RemoveContainer" containerID="b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779"
Jul 28 01:13:51.202853 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:13:51.202832    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779\": container with ID starting with b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779 not found: ID does not exist" containerID="b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779"
Jul 28 01:13:51.202910 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:51.202863    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779"} err="failed to get container status \"b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779\": rpc error: code = NotFound desc = could not find container \"b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779\": container with ID starting with b144704dbb14c6487d99e4ffd77bc69d9b90b68c1f0b01e68ddcfa42c4eee779 not found: ID does not exist"
Jul 28 01:13:51.212690 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:51.212661    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxckg"]
Jul 28 01:13:51.216220 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:51.216198    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxckg"]
Jul 28 01:13:52.021568 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:52.021538    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a542184-3473-4301-ab2d-cbde89dc4a58" path="/var/lib/kubelet/pods/3a542184-3473-4301-ab2d-cbde89dc4a58/volumes"
Jul 28 01:13:58.412320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:58.412278    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2gcr9"
Jul 28 01:13:58.412780 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:58.412347    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2gcr9"
Jul 28 01:13:58.433739 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:58.433715    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2gcr9"
Jul 28 01:13:59.250375 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:13:59.250351    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2gcr9"
Jul 28 01:14:13.832696 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:13.832661    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:13.880278 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:13.880248    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:15.881546 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:15.881507    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:15.931563 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:15.931529    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:17.134508 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.134476    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"]
Jul 28 01:14:17.134877 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.134818    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a542184-3473-4301-ab2d-cbde89dc4a58" containerName="registry-server"
Jul 28 01:14:17.134877 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.134833    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a542184-3473-4301-ab2d-cbde89dc4a58" containerName="registry-server"
Jul 28 01:14:17.134951 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.134931    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a542184-3473-4301-ab2d-cbde89dc4a58" containerName="registry-server"
Jul 28 01:14:17.138207 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.138187    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.141482 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.141460    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8k9rr\""
Jul 28 01:14:17.155925 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.155900    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"]
Jul 28 01:14:17.224939 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.224907    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.225124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.224960    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.225124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.224984    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d46pn\" (UniqueName: \"kubernetes.io/projected/943ac80b-ebf1-4ba4-8852-328b4102f668-kube-api-access-d46pn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.282893 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.282858    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:17.298971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.298944    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"]
Jul 28 01:14:17.301820 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.301805    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.311690 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.311667    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"]
Jul 28 01:14:17.326007 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.325977    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.326224 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.326019    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d46pn\" (UniqueName: \"kubernetes.io/projected/943ac80b-ebf1-4ba4-8852-328b4102f668-kube-api-access-d46pn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.326224 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.326176    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.326571 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.326542    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.326693 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.326671    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.334337 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.334308    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d46pn\" (UniqueName: \"kubernetes.io/projected/943ac80b-ebf1-4ba4-8852-328b4102f668-kube-api-access-d46pn\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.341583 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.341563    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:17.426655 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.426553    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.426655 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.426609    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.426860 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.426685    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttpd5\" (UniqueName: \"kubernetes.io/projected/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-kube-api-access-ttpd5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.446435 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.446407    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:17.528301 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.527411    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttpd5\" (UniqueName: \"kubernetes.io/projected/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-kube-api-access-ttpd5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.528301 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.527559    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.528301 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.527792    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.528301 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.528108    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.528525 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.528333    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.532306 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.532273    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"]
Jul 28 01:14:17.537296 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.537275    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.542386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.542356    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttpd5\" (UniqueName: \"kubernetes.io/projected/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-kube-api-access-ttpd5\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.546450 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.546426    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"]
Jul 28 01:14:17.580494 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.580467    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"]
Jul 28 01:14:17.583066 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:14:17.583034    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943ac80b_ebf1_4ba4_8852_328b4102f668.slice/crio-9ab6e0cd227bbfb2e0c18e6ee49ed75a5babac45c9f9dae8d31f7aa5c204b7b8 WatchSource:0}: Error finding container 9ab6e0cd227bbfb2e0c18e6ee49ed75a5babac45c9f9dae8d31f7aa5c204b7b8: Status 404 returned error can't find the container with id 9ab6e0cd227bbfb2e0c18e6ee49ed75a5babac45c9f9dae8d31f7aa5c204b7b8
Jul 28 01:14:17.611909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.611885    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:17.629256 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.629233    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.629349 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.629295    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.629400 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.629374    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tpx8\" (UniqueName: \"kubernetes.io/projected/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-kube-api-access-8tpx8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.681740 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.681712    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:17.730206 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.730171    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.730369 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.730229    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tpx8\" (UniqueName: \"kubernetes.io/projected/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-kube-api-access-8tpx8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.730369 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.730300    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.730593 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.730573    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.730661 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.730646    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.738798 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.738768    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tpx8\" (UniqueName: \"kubernetes.io/projected/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-kube-api-access-8tpx8\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.757554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.757528    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"]
Jul 28 01:14:17.760038 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:14:17.760010    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebabf26_ea92_4d0b_8bbc_81fe7f3648fe.slice/crio-899e40b076cba737eff5d723c63d8e6873a6a64e4efa19ea92e196bcf148f00b WatchSource:0}: Error finding container 899e40b076cba737eff5d723c63d8e6873a6a64e4efa19ea92e196bcf148f00b: Status 404 returned error can't find the container with id 899e40b076cba737eff5d723c63d8e6873a6a64e4efa19ea92e196bcf148f00b
Jul 28 01:14:17.762279 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.762237    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:17.857897 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.857861    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:17.934001 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.933930    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"]
Jul 28 01:14:17.936577 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.936560    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:17.946250 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.946190    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"]
Jul 28 01:14:17.998904 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:17.998873    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"]
Jul 28 01:14:18.002314 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:14:18.002292    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493d7ebf_91b6_4b03_a84e_5e37f3e66fab.slice/crio-ef325327cba9523b2180fc249604af0ea42e40a192cfa0e0e1c90423f6088a82 WatchSource:0}: Error finding container ef325327cba9523b2180fc249604af0ea42e40a192cfa0e0e1c90423f6088a82: Status 404 returned error can't find the container with id ef325327cba9523b2180fc249604af0ea42e40a192cfa0e0e1c90423f6088a82
Jul 28 01:14:18.032146 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.032110    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:18.032297 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.032212    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:18.032297 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.032258    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpdpn\" (UniqueName: \"kubernetes.io/projected/d93067be-5cd0-469a-8fbc-49ec9f06c387-kube-api-access-cpdpn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:18.132863 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.132828    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:18.133075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.132888    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpdpn\" (UniqueName: \"kubernetes.io/projected/d93067be-5cd0-469a-8fbc-49ec9f06c387-kube-api-access-cpdpn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:18.133075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.132950    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:18.133379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.133354    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:18.133441 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.133358    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:18.141503 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.141476    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpdpn\" (UniqueName: \"kubernetes.io/projected/d93067be-5cd0-469a-8fbc-49ec9f06c387-kube-api-access-cpdpn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:18.247245 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.247158    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:18.314453 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.314414    2552 generic.go:356] "Generic (PLEG): container finished" podID="493d7ebf-91b6-4b03-a84e-5e37f3e66fab" containerID="20db6fc797a5cddf8445b62509ae252173fe78da354a689c613110835f123552" exitCode=0
Jul 28 01:14:18.314626 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.314496    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj" event={"ID":"493d7ebf-91b6-4b03-a84e-5e37f3e66fab","Type":"ContainerDied","Data":"20db6fc797a5cddf8445b62509ae252173fe78da354a689c613110835f123552"}
Jul 28 01:14:18.314626 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.314553    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj" event={"ID":"493d7ebf-91b6-4b03-a84e-5e37f3e66fab","Type":"ContainerStarted","Data":"ef325327cba9523b2180fc249604af0ea42e40a192cfa0e0e1c90423f6088a82"}
Jul 28 01:14:18.316482 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.316457    2552 generic.go:356] "Generic (PLEG): container finished" podID="4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" containerID="8018631ddeb554e46ab943f2ddca48e6251bfa55af37bcb60e1e193f712cfdeb" exitCode=0
Jul 28 01:14:18.316597 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.316541    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n" event={"ID":"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe","Type":"ContainerDied","Data":"8018631ddeb554e46ab943f2ddca48e6251bfa55af37bcb60e1e193f712cfdeb"}
Jul 28 01:14:18.316597 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.316589    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n" event={"ID":"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe","Type":"ContainerStarted","Data":"899e40b076cba737eff5d723c63d8e6873a6a64e4efa19ea92e196bcf148f00b"}
Jul 28 01:14:18.318419 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.318400    2552 generic.go:356] "Generic (PLEG): container finished" podID="943ac80b-ebf1-4ba4-8852-328b4102f668" containerID="13c34127720e01866145f2dd16a67c0b763db8382de610a0415b2a2fd79a95bc" exitCode=0
Jul 28 01:14:18.318514 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.318500    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w" event={"ID":"943ac80b-ebf1-4ba4-8852-328b4102f668","Type":"ContainerDied","Data":"13c34127720e01866145f2dd16a67c0b763db8382de610a0415b2a2fd79a95bc"}
Jul 28 01:14:18.318564 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.318535    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w" event={"ID":"943ac80b-ebf1-4ba4-8852-328b4102f668","Type":"ContainerStarted","Data":"9ab6e0cd227bbfb2e0c18e6ee49ed75a5babac45c9f9dae8d31f7aa5c204b7b8"}
Jul 28 01:14:18.383713 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:18.383686    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"]
Jul 28 01:14:18.385329 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:14:18.385297    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93067be_5cd0_469a_8fbc_49ec9f06c387.slice/crio-8f90ae7ef8e5b6c6e6529541356f8674ffe99e51d6388515f1665d02e51c0c02 WatchSource:0}: Error finding container 8f90ae7ef8e5b6c6e6529541356f8674ffe99e51d6388515f1665d02e51c0c02: Status 404 returned error can't find the container with id 8f90ae7ef8e5b6c6e6529541356f8674ffe99e51d6388515f1665d02e51c0c02
Jul 28 01:14:19.282484 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:19.282448    2552 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ebabf26_ea92_4d0b_8bbc_81fe7f3648fe.slice/crio-conmon-9d4c5f88e9e9a788409ad1cb14968f39afdba214132ef54971d58255d8b338de.scope\": RecentStats: unable to find data in memory cache]"
Jul 28 01:14:19.326440 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:19.326359    2552 generic.go:356] "Generic (PLEG): container finished" podID="493d7ebf-91b6-4b03-a84e-5e37f3e66fab" containerID="f72c8f9af40580723bb87779a228cb46e8671fc7166ccb038d832c31b0de6621" exitCode=0
Jul 28 01:14:19.326609 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:19.326435    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj" event={"ID":"493d7ebf-91b6-4b03-a84e-5e37f3e66fab","Type":"ContainerDied","Data":"f72c8f9af40580723bb87779a228cb46e8671fc7166ccb038d832c31b0de6621"}
Jul 28 01:14:19.328268 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:19.328247    2552 generic.go:356] "Generic (PLEG): container finished" podID="4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" containerID="9d4c5f88e9e9a788409ad1cb14968f39afdba214132ef54971d58255d8b338de" exitCode=0
Jul 28 01:14:19.328368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:19.328324    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n" event={"ID":"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe","Type":"ContainerDied","Data":"9d4c5f88e9e9a788409ad1cb14968f39afdba214132ef54971d58255d8b338de"}
Jul 28 01:14:19.329833 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:19.329809    2552 generic.go:356] "Generic (PLEG): container finished" podID="d93067be-5cd0-469a-8fbc-49ec9f06c387" containerID="a03eb7c6bb89eb6e61cab34178215d8e4882507d105ce36a92ff0a0d2ac47999" exitCode=0
Jul 28 01:14:19.329919 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:19.329846    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v" event={"ID":"d93067be-5cd0-469a-8fbc-49ec9f06c387","Type":"ContainerDied","Data":"a03eb7c6bb89eb6e61cab34178215d8e4882507d105ce36a92ff0a0d2ac47999"}
Jul 28 01:14:19.329919 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:19.329885    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v" event={"ID":"d93067be-5cd0-469a-8fbc-49ec9f06c387","Type":"ContainerStarted","Data":"8f90ae7ef8e5b6c6e6529541356f8674ffe99e51d6388515f1665d02e51c0c02"}
Jul 28 01:14:20.336513 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:20.336478    2552 generic.go:356] "Generic (PLEG): container finished" podID="493d7ebf-91b6-4b03-a84e-5e37f3e66fab" containerID="307b08a311118fab6eb3a724ae918982d39e3ad084646794276f354febda1817" exitCode=0
Jul 28 01:14:20.336946 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:20.336537    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj" event={"ID":"493d7ebf-91b6-4b03-a84e-5e37f3e66fab","Type":"ContainerDied","Data":"307b08a311118fab6eb3a724ae918982d39e3ad084646794276f354febda1817"}
Jul 28 01:14:20.338678 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:20.338648    2552 generic.go:356] "Generic (PLEG): container finished" podID="4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" containerID="79d396db5a89091d9b14e27ac1dad5a621c42931a3902bf73f1ef0d017b520e4" exitCode=0
Jul 28 01:14:20.338785 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:20.338724    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n" event={"ID":"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe","Type":"ContainerDied","Data":"79d396db5a89091d9b14e27ac1dad5a621c42931a3902bf73f1ef0d017b520e4"}
Jul 28 01:14:20.340650 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:20.340630    2552 generic.go:356] "Generic (PLEG): container finished" podID="943ac80b-ebf1-4ba4-8852-328b4102f668" containerID="4efcdb301ea162e563cca3bc400c9bc15407dac0d16008687b89134d3cc3fb3d" exitCode=0
Jul 28 01:14:20.340775 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:20.340730    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w" event={"ID":"943ac80b-ebf1-4ba4-8852-328b4102f668","Type":"ContainerDied","Data":"4efcdb301ea162e563cca3bc400c9bc15407dac0d16008687b89134d3cc3fb3d"}
Jul 28 01:14:20.342780 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:20.342760    2552 generic.go:356] "Generic (PLEG): container finished" podID="d93067be-5cd0-469a-8fbc-49ec9f06c387" containerID="8f1b3fe206bee61703842992c403e3e33d69069c235938fe890eda2367877b3a" exitCode=0
Jul 28 01:14:20.342882 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:20.342788    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v" event={"ID":"d93067be-5cd0-469a-8fbc-49ec9f06c387","Type":"ContainerDied","Data":"8f1b3fe206bee61703842992c403e3e33d69069c235938fe890eda2367877b3a"}
Jul 28 01:14:21.348910 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.348868    2552 generic.go:356] "Generic (PLEG): container finished" podID="943ac80b-ebf1-4ba4-8852-328b4102f668" containerID="c1a75b1c6bcf5c5c9e9114be6d11c85a7de08db621b7bb5faaba50698de2af2f" exitCode=0
Jul 28 01:14:21.349367 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.348951    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w" event={"ID":"943ac80b-ebf1-4ba4-8852-328b4102f668","Type":"ContainerDied","Data":"c1a75b1c6bcf5c5c9e9114be6d11c85a7de08db621b7bb5faaba50698de2af2f"}
Jul 28 01:14:21.350977 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.350954    2552 generic.go:356] "Generic (PLEG): container finished" podID="d93067be-5cd0-469a-8fbc-49ec9f06c387" containerID="9ccd975bdfc0c23fc49259b19c6f9917ed10e2a4baf4bbd231ad5a2be8cae0bf" exitCode=0
Jul 28 01:14:21.351098 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.351025    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v" event={"ID":"d93067be-5cd0-469a-8fbc-49ec9f06c387","Type":"ContainerDied","Data":"9ccd975bdfc0c23fc49259b19c6f9917ed10e2a4baf4bbd231ad5a2be8cae0bf"}
Jul 28 01:14:21.485238 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.485214    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:21.515766 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.515741    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:21.563665 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.563637    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-util\") pod \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") "
Jul 28 01:14:21.563845 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.563709    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tpx8\" (UniqueName: \"kubernetes.io/projected/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-kube-api-access-8tpx8\") pod \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") "
Jul 28 01:14:21.563845 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.563764    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-bundle\") pod \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\" (UID: \"493d7ebf-91b6-4b03-a84e-5e37f3e66fab\") "
Jul 28 01:14:21.564305 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.564283    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-bundle" (OuterVolumeSpecName: "bundle") pod "493d7ebf-91b6-4b03-a84e-5e37f3e66fab" (UID: "493d7ebf-91b6-4b03-a84e-5e37f3e66fab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:14:21.565979 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.565955    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-kube-api-access-8tpx8" (OuterVolumeSpecName: "kube-api-access-8tpx8") pod "493d7ebf-91b6-4b03-a84e-5e37f3e66fab" (UID: "493d7ebf-91b6-4b03-a84e-5e37f3e66fab"). InnerVolumeSpecName "kube-api-access-8tpx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:14:21.569057 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.569032    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-util" (OuterVolumeSpecName: "util") pod "493d7ebf-91b6-4b03-a84e-5e37f3e66fab" (UID: "493d7ebf-91b6-4b03-a84e-5e37f3e66fab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:14:21.664441 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.664409    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttpd5\" (UniqueName: \"kubernetes.io/projected/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-kube-api-access-ttpd5\") pod \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") "
Jul 28 01:14:21.664591 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.664462    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-util\") pod \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") "
Jul 28 01:14:21.664591 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.664524    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-bundle\") pod \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\" (UID: \"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe\") "
Jul 28 01:14:21.664797 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.664780    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tpx8\" (UniqueName: \"kubernetes.io/projected/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-kube-api-access-8tpx8\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:21.664840 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.664804    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:21.664840 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.664826    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/493d7ebf-91b6-4b03-a84e-5e37f3e66fab-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:21.665054 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.665033    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-bundle" (OuterVolumeSpecName: "bundle") pod "4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" (UID: "4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:14:21.667308 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.667284    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-kube-api-access-ttpd5" (OuterVolumeSpecName: "kube-api-access-ttpd5") pod "4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" (UID: "4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe"). InnerVolumeSpecName "kube-api-access-ttpd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:14:21.669857 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.669835    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-util" (OuterVolumeSpecName: "util") pod "4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" (UID: "4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:14:21.766019 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.765982    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:21.766019 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.766011    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:21.766019 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:21.766020    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttpd5\" (UniqueName: \"kubernetes.io/projected/4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe-kube-api-access-ttpd5\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:22.358028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.357942    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj" event={"ID":"493d7ebf-91b6-4b03-a84e-5e37f3e66fab","Type":"ContainerDied","Data":"ef325327cba9523b2180fc249604af0ea42e40a192cfa0e0e1c90423f6088a82"}
Jul 28 01:14:22.358028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.357994    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef325327cba9523b2180fc249604af0ea42e40a192cfa0e0e1c90423f6088a82"
Jul 28 01:14:22.358028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.357957    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj"
Jul 28 01:14:22.360073 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.360048    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n"
Jul 28 01:14:22.360233 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.360029    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n" event={"ID":"4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe","Type":"ContainerDied","Data":"899e40b076cba737eff5d723c63d8e6873a6a64e4efa19ea92e196bcf148f00b"}
Jul 28 01:14:22.360233 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.360150    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="899e40b076cba737eff5d723c63d8e6873a6a64e4efa19ea92e196bcf148f00b"
Jul 28 01:14:22.495194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.495165    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:22.528605 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.528580    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:22.573209 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.573180    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpdpn\" (UniqueName: \"kubernetes.io/projected/d93067be-5cd0-469a-8fbc-49ec9f06c387-kube-api-access-cpdpn\") pod \"d93067be-5cd0-469a-8fbc-49ec9f06c387\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") "
Jul 28 01:14:22.573367 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.573266    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-bundle\") pod \"d93067be-5cd0-469a-8fbc-49ec9f06c387\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") "
Jul 28 01:14:22.573367 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.573294    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-util\") pod \"d93067be-5cd0-469a-8fbc-49ec9f06c387\" (UID: \"d93067be-5cd0-469a-8fbc-49ec9f06c387\") "
Jul 28 01:14:22.573832 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.573790    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-bundle" (OuterVolumeSpecName: "bundle") pod "d93067be-5cd0-469a-8fbc-49ec9f06c387" (UID: "d93067be-5cd0-469a-8fbc-49ec9f06c387"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:14:22.575398 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.575376    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93067be-5cd0-469a-8fbc-49ec9f06c387-kube-api-access-cpdpn" (OuterVolumeSpecName: "kube-api-access-cpdpn") pod "d93067be-5cd0-469a-8fbc-49ec9f06c387" (UID: "d93067be-5cd0-469a-8fbc-49ec9f06c387"). InnerVolumeSpecName "kube-api-access-cpdpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:14:22.578973 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.578940    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-util" (OuterVolumeSpecName: "util") pod "d93067be-5cd0-469a-8fbc-49ec9f06c387" (UID: "d93067be-5cd0-469a-8fbc-49ec9f06c387"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:14:22.673843 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.673816    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-bundle\") pod \"943ac80b-ebf1-4ba4-8852-328b4102f668\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") "
Jul 28 01:14:22.674025 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.673849    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-util\") pod \"943ac80b-ebf1-4ba4-8852-328b4102f668\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") "
Jul 28 01:14:22.674025 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.673878    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d46pn\" (UniqueName: \"kubernetes.io/projected/943ac80b-ebf1-4ba4-8852-328b4102f668-kube-api-access-d46pn\") pod \"943ac80b-ebf1-4ba4-8852-328b4102f668\" (UID: \"943ac80b-ebf1-4ba4-8852-328b4102f668\") "
Jul 28 01:14:22.674169 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.674076    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:22.674169 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.674086    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d93067be-5cd0-469a-8fbc-49ec9f06c387-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:22.674169 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.674095    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpdpn\" (UniqueName: \"kubernetes.io/projected/d93067be-5cd0-469a-8fbc-49ec9f06c387-kube-api-access-cpdpn\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:22.674578 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.674555    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-bundle" (OuterVolumeSpecName: "bundle") pod "943ac80b-ebf1-4ba4-8852-328b4102f668" (UID: "943ac80b-ebf1-4ba4-8852-328b4102f668"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:14:22.676054 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.676033    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/943ac80b-ebf1-4ba4-8852-328b4102f668-kube-api-access-d46pn" (OuterVolumeSpecName: "kube-api-access-d46pn") pod "943ac80b-ebf1-4ba4-8852-328b4102f668" (UID: "943ac80b-ebf1-4ba4-8852-328b4102f668"). InnerVolumeSpecName "kube-api-access-d46pn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:14:22.679655 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.679617    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-util" (OuterVolumeSpecName: "util") pod "943ac80b-ebf1-4ba4-8852-328b4102f668" (UID: "943ac80b-ebf1-4ba4-8852-328b4102f668"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:14:22.775160 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.775102    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d46pn\" (UniqueName: \"kubernetes.io/projected/943ac80b-ebf1-4ba4-8852-328b4102f668-kube-api-access-d46pn\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:22.775160 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.775159    2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:22.775160 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:22.775168    2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/943ac80b-ebf1-4ba4-8852-328b4102f668-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:23.367462 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:23.367435    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w"
Jul 28 01:14:23.367462 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:23.367442    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w" event={"ID":"943ac80b-ebf1-4ba4-8852-328b4102f668","Type":"ContainerDied","Data":"9ab6e0cd227bbfb2e0c18e6ee49ed75a5babac45c9f9dae8d31f7aa5c204b7b8"}
Jul 28 01:14:23.367918 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:23.367482    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ab6e0cd227bbfb2e0c18e6ee49ed75a5babac45c9f9dae8d31f7aa5c204b7b8"
Jul 28 01:14:23.369507 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:23.369487    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v"
Jul 28 01:14:23.369617 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:23.369485    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v" event={"ID":"d93067be-5cd0-469a-8fbc-49ec9f06c387","Type":"ContainerDied","Data":"8f90ae7ef8e5b6c6e6529541356f8674ffe99e51d6388515f1665d02e51c0c02"}
Jul 28 01:14:23.369617 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:23.369601    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f90ae7ef8e5b6c6e6529541356f8674ffe99e51d6388515f1665d02e51c0c02"
Jul 28 01:14:27.936211 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:27.936175    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:29.459727 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:29.459693    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:33.308887 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:33.308855    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:34.408702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.408661    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"]
Jul 28 01:14:34.409235 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409213    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493d7ebf-91b6-4b03-a84e-5e37f3e66fab" containerName="pull"
Jul 28 01:14:34.409320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409238    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="493d7ebf-91b6-4b03-a84e-5e37f3e66fab" containerName="pull"
Jul 28 01:14:34.409320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409251    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943ac80b-ebf1-4ba4-8852-328b4102f668" containerName="util"
Jul 28 01:14:34.409320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409259    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="943ac80b-ebf1-4ba4-8852-328b4102f668" containerName="util"
Jul 28 01:14:34.409320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409274    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493d7ebf-91b6-4b03-a84e-5e37f3e66fab" containerName="util"
Jul 28 01:14:34.409320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409282    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="493d7ebf-91b6-4b03-a84e-5e37f3e66fab" containerName="util"
Jul 28 01:14:34.409320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409292    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93067be-5cd0-469a-8fbc-49ec9f06c387" containerName="pull"
Jul 28 01:14:34.409320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409301    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93067be-5cd0-469a-8fbc-49ec9f06c387" containerName="pull"
Jul 28 01:14:34.409320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409313    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93067be-5cd0-469a-8fbc-49ec9f06c387" containerName="util"
Jul 28 01:14:34.409320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409322    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93067be-5cd0-469a-8fbc-49ec9f06c387" containerName="util"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409336    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943ac80b-ebf1-4ba4-8852-328b4102f668" containerName="pull"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409343    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="943ac80b-ebf1-4ba4-8852-328b4102f668" containerName="pull"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409357    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" containerName="pull"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409365    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" containerName="pull"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409373    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493d7ebf-91b6-4b03-a84e-5e37f3e66fab" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409381    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="493d7ebf-91b6-4b03-a84e-5e37f3e66fab" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409399    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" containerName="util"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409408    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" containerName="util"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409416    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="943ac80b-ebf1-4ba4-8852-328b4102f668" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409423    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="943ac80b-ebf1-4ba4-8852-328b4102f668" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409438    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93067be-5cd0-469a-8fbc-49ec9f06c387" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409447    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93067be-5cd0-469a-8fbc-49ec9f06c387" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409459    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409466    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409550    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="943ac80b-ebf1-4ba4-8852-328b4102f668" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409563    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93067be-5cd0-469a-8fbc-49ec9f06c387" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409574    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="493d7ebf-91b6-4b03-a84e-5e37f3e66fab" containerName="extract"
Jul 28 01:14:34.409743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.409584    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe" containerName="extract"
Jul 28 01:14:34.412888 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.412868    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:34.415522 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.415500    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9zxl2\""
Jul 28 01:14:34.425357 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.425332    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"]
Jul 28 01:14:34.578711 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.578667    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ns5j\" (UniqueName: \"kubernetes.io/projected/a854362f-6de7-4bf4-af9b-401f3493a5ae-kube-api-access-7ns5j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" (UID: \"a854362f-6de7-4bf4-af9b-401f3493a5ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:34.578711 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.578722    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a854362f-6de7-4bf4-af9b-401f3493a5ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" (UID: \"a854362f-6de7-4bf4-af9b-401f3493a5ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:34.658477 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.658447    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:34.679760 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.679697    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ns5j\" (UniqueName: \"kubernetes.io/projected/a854362f-6de7-4bf4-af9b-401f3493a5ae-kube-api-access-7ns5j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" (UID: \"a854362f-6de7-4bf4-af9b-401f3493a5ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:34.679760 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.679740    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a854362f-6de7-4bf4-af9b-401f3493a5ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" (UID: \"a854362f-6de7-4bf4-af9b-401f3493a5ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:34.680098 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.680082    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a854362f-6de7-4bf4-af9b-401f3493a5ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" (UID: \"a854362f-6de7-4bf4-af9b-401f3493a5ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:34.692699 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.692669    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ns5j\" (UniqueName: \"kubernetes.io/projected/a854362f-6de7-4bf4-af9b-401f3493a5ae-kube-api-access-7ns5j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" (UID: \"a854362f-6de7-4bf4-af9b-401f3493a5ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:34.722636 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.722612    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:34.858815 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:34.858790    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"]
Jul 28 01:14:34.861594 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:14:34.861569    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda854362f_6de7_4bf4_af9b_401f3493a5ae.slice/crio-900c1db0ad3389f7e97bb577114c5a36ff48e1719498be0e2df7270dd0026b42 WatchSource:0}: Error finding container 900c1db0ad3389f7e97bb577114c5a36ff48e1719498be0e2df7270dd0026b42: Status 404 returned error can't find the container with id 900c1db0ad3389f7e97bb577114c5a36ff48e1719498be0e2df7270dd0026b42
Jul 28 01:14:35.061735 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:35.061662    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:35.432578 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:35.432544    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v" event={"ID":"a854362f-6de7-4bf4-af9b-401f3493a5ae","Type":"ContainerStarted","Data":"900c1db0ad3389f7e97bb577114c5a36ff48e1719498be0e2df7270dd0026b42"}
Jul 28 01:14:36.107608 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:36.107563    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:37.033124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.033086    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4"]
Jul 28 01:14:37.036818 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.036793    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4"
Jul 28 01:14:37.040030 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.039997    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7j7cz\""
Jul 28 01:14:37.068100 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.068066    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4"]
Jul 28 01:14:37.205216 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.205182    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x952\" (UniqueName: \"kubernetes.io/projected/140701c5-f4ae-413a-9f16-6a751e39e72e-kube-api-access-5x952\") pod \"authorino-operator-75cc8d5cb7-cxpr4\" (UID: \"140701c5-f4ae-413a-9f16-6a751e39e72e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4"
Jul 28 01:14:37.306016 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.305938    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x952\" (UniqueName: \"kubernetes.io/projected/140701c5-f4ae-413a-9f16-6a751e39e72e-kube-api-access-5x952\") pod \"authorino-operator-75cc8d5cb7-cxpr4\" (UID: \"140701c5-f4ae-413a-9f16-6a751e39e72e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4"
Jul 28 01:14:37.317563 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.317538    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x952\" (UniqueName: \"kubernetes.io/projected/140701c5-f4ae-413a-9f16-6a751e39e72e-kube-api-access-5x952\") pod \"authorino-operator-75cc8d5cb7-cxpr4\" (UID: \"140701c5-f4ae-413a-9f16-6a751e39e72e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4"
Jul 28 01:14:37.350368 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.350332    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4"
Jul 28 01:14:37.495073 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.495045    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4"]
Jul 28 01:14:37.496589 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:14:37.496565    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140701c5_f4ae_413a_9f16_6a751e39e72e.slice/crio-268b041d585349d672c10b2f4c75bb06b641a91e20e8a4f7466a28b562f3c541 WatchSource:0}: Error finding container 268b041d585349d672c10b2f4c75bb06b641a91e20e8a4f7466a28b562f3c541: Status 404 returned error can't find the container with id 268b041d585349d672c10b2f4c75bb06b641a91e20e8a4f7466a28b562f3c541
Jul 28 01:14:37.685740 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.685710    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:37.787546 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:37.787509    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:38.454032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:38.453992    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4" event={"ID":"140701c5-f4ae-413a-9f16-6a751e39e72e","Type":"ContainerStarted","Data":"268b041d585349d672c10b2f4c75bb06b641a91e20e8a4f7466a28b562f3c541"}
Jul 28 01:14:39.331250 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:39.331221    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk"]
Jul 28 01:14:39.340016 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:39.339984    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk"
Jul 28 01:14:39.344278 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:39.344252    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-j9rzk\""
Jul 28 01:14:39.344887 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:39.344856    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 28 01:14:39.351039 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:39.351014    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk"]
Jul 28 01:14:39.528164 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:39.528102    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grsr5\" (UniqueName: \"kubernetes.io/projected/ef2c6eac-9fc7-4685-a85c-a015cd2b0f22-kube-api-access-grsr5\") pod \"dns-operator-controller-manager-864dd78c4c-ll4mk\" (UID: \"ef2c6eac-9fc7-4685-a85c-a015cd2b0f22\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk"
Jul 28 01:14:39.629165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:39.629048    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grsr5\" (UniqueName: \"kubernetes.io/projected/ef2c6eac-9fc7-4685-a85c-a015cd2b0f22-kube-api-access-grsr5\") pod \"dns-operator-controller-manager-864dd78c4c-ll4mk\" (UID: \"ef2c6eac-9fc7-4685-a85c-a015cd2b0f22\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk"
Jul 28 01:14:39.640478 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:39.640454    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grsr5\" (UniqueName: \"kubernetes.io/projected/ef2c6eac-9fc7-4685-a85c-a015cd2b0f22-kube-api-access-grsr5\") pod \"dns-operator-controller-manager-864dd78c4c-ll4mk\" (UID: \"ef2c6eac-9fc7-4685-a85c-a015cd2b0f22\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk"
Jul 28 01:14:39.655243 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:39.655214    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk"
Jul 28 01:14:39.869506 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:39.869475    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:41.318985 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.318957    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk"]
Jul 28 01:14:41.320676 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:14:41.320645    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2c6eac_9fc7_4685_a85c_a015cd2b0f22.slice/crio-e4caca5ed004a38eed005c870e3d9a3ca3899b23c34de0313f60896ca67c57be WatchSource:0}: Error finding container e4caca5ed004a38eed005c870e3d9a3ca3899b23c34de0313f60896ca67c57be: Status 404 returned error can't find the container with id e4caca5ed004a38eed005c870e3d9a3ca3899b23c34de0313f60896ca67c57be
Jul 28 01:14:41.333804 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.333769    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"]
Jul 28 01:14:41.337490 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.337469    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:41.339813 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.339792    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-t2fd7\""
Jul 28 01:14:41.344614 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.344559    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj4wp\" (UniqueName: \"kubernetes.io/projected/f55777a1-e360-4753-bfdb-ab2ca232566e-kube-api-access-dj4wp\") pod \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" (UID: \"f55777a1-e360-4753-bfdb-ab2ca232566e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:41.348116 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.348090    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"]
Jul 28 01:14:41.445653 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.445547    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj4wp\" (UniqueName: \"kubernetes.io/projected/f55777a1-e360-4753-bfdb-ab2ca232566e-kube-api-access-dj4wp\") pod \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" (UID: \"f55777a1-e360-4753-bfdb-ab2ca232566e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:41.459567 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.459536    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj4wp\" (UniqueName: \"kubernetes.io/projected/f55777a1-e360-4753-bfdb-ab2ca232566e-kube-api-access-dj4wp\") pod \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" (UID: \"f55777a1-e360-4753-bfdb-ab2ca232566e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:41.474203 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.474163    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v" event={"ID":"a854362f-6de7-4bf4-af9b-401f3493a5ae","Type":"ContainerStarted","Data":"a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435"}
Jul 28 01:14:41.474400 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.474238    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:41.475991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.475962    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4" event={"ID":"140701c5-f4ae-413a-9f16-6a751e39e72e","Type":"ContainerStarted","Data":"e547de91898f9a3675702d527a65c9a813b8dae0f75c94077722f7c15aa022ae"}
Jul 28 01:14:41.476118 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.476021    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4"
Jul 28 01:14:41.477347 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.477323    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk" event={"ID":"ef2c6eac-9fc7-4685-a85c-a015cd2b0f22","Type":"ContainerStarted","Data":"e4caca5ed004a38eed005c870e3d9a3ca3899b23c34de0313f60896ca67c57be"}
Jul 28 01:14:41.523871 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.523798    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v" podStartSLOduration=1.200183881 podStartE2EDuration="7.523780373s" totalImagesPullingTime="6.323596492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:14:41.522533642 +0000 UTC m=+614.136841715" watchObservedRunningTime="2026-07-28 01:14:41.523780373 +0000 UTC m=+614.138088444"
Jul 28 01:14:41.566564 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.566511    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4" podStartSLOduration=1.896003356 podStartE2EDuration="5.566492504s" totalImagesPullingTime="3.670489148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:14:41.564429831 +0000 UTC m=+614.178737907" watchObservedRunningTime="2026-07-28 01:14:41.566492504 +0000 UTC m=+614.180800576"
Jul 28 01:14:41.650840 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.650795    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:41.705558 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.705524    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:41.794580 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:41.794552    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"]
Jul 28 01:14:41.799154 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:14:41.799111    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55777a1_e360_4753_bfdb_ab2ca232566e.slice/crio-6547eb5746afc4c2052a43514c702ce59b4d95392b6ba91e2e13724b40a87d0d WatchSource:0}: Error finding container 6547eb5746afc4c2052a43514c702ce59b4d95392b6ba91e2e13724b40a87d0d: Status 404 returned error can't find the container with id 6547eb5746afc4c2052a43514c702ce59b4d95392b6ba91e2e13724b40a87d0d
Jul 28 01:14:42.484959 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:42.484927    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q" event={"ID":"f55777a1-e360-4753-bfdb-ab2ca232566e","Type":"ContainerStarted","Data":"6547eb5746afc4c2052a43514c702ce59b4d95392b6ba91e2e13724b40a87d0d"}
Jul 28 01:14:43.464008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:43.463976    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:43.564723 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:43.564688    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:44.251277 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:44.251200    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:44.498828 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:44.498783    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk" event={"ID":"ef2c6eac-9fc7-4685-a85c-a015cd2b0f22","Type":"ContainerStarted","Data":"05c7b70185b9653c1663c818b539aa6ecc182f2e9ffc891182cfedf4f1219520"}
Jul 28 01:14:44.498996 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:44.498948    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk"
Jul 28 01:14:44.500248 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:44.500226    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q" event={"ID":"f55777a1-e360-4753-bfdb-ab2ca232566e","Type":"ContainerStarted","Data":"cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff"}
Jul 28 01:14:44.500351 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:44.500273    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:44.517170 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:44.517063    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk" podStartSLOduration=3.266948277 podStartE2EDuration="5.51704927s" totalImagesPullingTime="2.250100993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:14:44.514905735 +0000 UTC m=+617.129213841" watchObservedRunningTime="2026-07-28 01:14:44.51704927 +0000 UTC m=+617.131357342"
Jul 28 01:14:44.530865 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:44.530821    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q" podStartSLOduration=1.344739925 podStartE2EDuration="3.530808839s" totalImagesPullingTime="2.186068914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:14:44.528693617 +0000 UTC m=+617.143001689" watchObservedRunningTime="2026-07-28 01:14:44.530808839 +0000 UTC m=+617.145116910"
Jul 28 01:14:44.797717 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:44.797635    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:52.487726 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:52.487646    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxpr4"
Jul 28 01:14:52.488187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:52.487745    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:52.686228 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:52.686195    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:52.783250 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:52.783167    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:54.148967 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.148930    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"]
Jul 28 01:14:54.149405 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.149157    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" containerName="manager" containerID="cri-o://a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435" gracePeriod=2
Jul 28 01:14:54.158634 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.158607    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"]
Jul 28 01:14:54.159232 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.159200    2552 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a854362f-6de7-4bf4-af9b-401f3493a5ae\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\": pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.168951 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.168921    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"]
Jul 28 01:14:54.169226 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.169124    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" containerName="manager" containerID="cri-o://cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff" gracePeriod=2
Jul 28 01:14:54.171412 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.171394    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.171582 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.171554    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.177447 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.177418    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"]
Jul 28 01:14:54.177855 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.177839    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" containerName="manager"
Jul 28 01:14:54.177903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.177860    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" containerName="manager"
Jul 28 01:14:54.177977 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.177966    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" containerName="manager"
Jul 28 01:14:54.181731 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.181708    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:14:54.182594 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.182571    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"]
Jul 28 01:14:54.191330 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.191275    2552 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f55777a1-e360-4753-bfdb-ab2ca232566e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-7cs7q\": pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.193495 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.193468    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.195830 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.195800    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.198123 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.198097    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"]
Jul 28 01:14:54.204795 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.204766    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5"]
Jul 28 01:14:54.205194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.205180    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" containerName="manager"
Jul 28 01:14:54.205243 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.205195    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" containerName="manager"
Jul 28 01:14:54.205278 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.205273    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" containerName="manager"
Jul 28 01:14:54.208455 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.208436    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5"
Jul 28 01:14:54.218954 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.218915    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5"]
Jul 28 01:14:54.244111 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.244081    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e58f4a6-e992-43d4-8337-ce59b7adecfa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gq29g\" (UID: \"8e58f4a6-e992-43d4-8337-ce59b7adecfa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:14:54.244329 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.244126    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zf9p\" (UniqueName: \"kubernetes.io/projected/07dee455-ce1d-4dee-b3a0-2ef36b0b52e9-kube-api-access-9zf9p\") pod \"limitador-operator-controller-manager-859d7b78bd-h2ld5\" (UID: \"07dee455-ce1d-4dee-b3a0-2ef36b0b52e9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5"
Jul 28 01:14:54.244329 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.244181    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7fzr\" (UniqueName: \"kubernetes.io/projected/8e58f4a6-e992-43d4-8337-ce59b7adecfa-kube-api-access-p7fzr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gq29g\" (UID: \"8e58f4a6-e992-43d4-8337-ce59b7adecfa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:14:54.251756 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.251723    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.253671 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.253646    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.346761 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.345603    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e58f4a6-e992-43d4-8337-ce59b7adecfa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gq29g\" (UID: \"8e58f4a6-e992-43d4-8337-ce59b7adecfa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:14:54.346761 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.345672    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zf9p\" (UniqueName: \"kubernetes.io/projected/07dee455-ce1d-4dee-b3a0-2ef36b0b52e9-kube-api-access-9zf9p\") pod \"limitador-operator-controller-manager-859d7b78bd-h2ld5\" (UID: \"07dee455-ce1d-4dee-b3a0-2ef36b0b52e9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5"
Jul 28 01:14:54.346761 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.345712    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7fzr\" (UniqueName: \"kubernetes.io/projected/8e58f4a6-e992-43d4-8337-ce59b7adecfa-kube-api-access-p7fzr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gq29g\" (UID: \"8e58f4a6-e992-43d4-8337-ce59b7adecfa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:14:54.346761 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.346482    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e58f4a6-e992-43d4-8337-ce59b7adecfa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gq29g\" (UID: \"8e58f4a6-e992-43d4-8337-ce59b7adecfa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:14:54.355191 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.355122    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7fzr\" (UniqueName: \"kubernetes.io/projected/8e58f4a6-e992-43d4-8337-ce59b7adecfa-kube-api-access-p7fzr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gq29g\" (UID: \"8e58f4a6-e992-43d4-8337-ce59b7adecfa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:14:54.355653 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.355634    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zf9p\" (UniqueName: \"kubernetes.io/projected/07dee455-ce1d-4dee-b3a0-2ef36b0b52e9-kube-api-access-9zf9p\") pod \"limitador-operator-controller-manager-859d7b78bd-h2ld5\" (UID: \"07dee455-ce1d-4dee-b3a0-2ef36b0b52e9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5"
Jul 28 01:14:54.409317 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.409287    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.411620 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.411588    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.411799 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.411785    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.413685 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.413659    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.417489 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.417461    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.420622 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.420593    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.447179 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.447122    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj4wp\" (UniqueName: \"kubernetes.io/projected/f55777a1-e360-4753-bfdb-ab2ca232566e-kube-api-access-dj4wp\") pod \"f55777a1-e360-4753-bfdb-ab2ca232566e\" (UID: \"f55777a1-e360-4753-bfdb-ab2ca232566e\") "
Jul 28 01:14:54.447314 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.447207    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ns5j\" (UniqueName: \"kubernetes.io/projected/a854362f-6de7-4bf4-af9b-401f3493a5ae-kube-api-access-7ns5j\") pod \"a854362f-6de7-4bf4-af9b-401f3493a5ae\" (UID: \"a854362f-6de7-4bf4-af9b-401f3493a5ae\") "
Jul 28 01:14:54.447314 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.447235    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a854362f-6de7-4bf4-af9b-401f3493a5ae-extensions-socket-volume\") pod \"a854362f-6de7-4bf4-af9b-401f3493a5ae\" (UID: \"a854362f-6de7-4bf4-af9b-401f3493a5ae\") "
Jul 28 01:14:54.447756 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.447732    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a854362f-6de7-4bf4-af9b-401f3493a5ae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a854362f-6de7-4bf4-af9b-401f3493a5ae" (UID: "a854362f-6de7-4bf4-af9b-401f3493a5ae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:14:54.449478 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.449454    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f55777a1-e360-4753-bfdb-ab2ca232566e-kube-api-access-dj4wp" (OuterVolumeSpecName: "kube-api-access-dj4wp") pod "f55777a1-e360-4753-bfdb-ab2ca232566e" (UID: "f55777a1-e360-4753-bfdb-ab2ca232566e"). InnerVolumeSpecName "kube-api-access-dj4wp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:14:54.449478 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.449462    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a854362f-6de7-4bf4-af9b-401f3493a5ae-kube-api-access-7ns5j" (OuterVolumeSpecName: "kube-api-access-7ns5j") pod "a854362f-6de7-4bf4-af9b-401f3493a5ae" (UID: "a854362f-6de7-4bf4-af9b-401f3493a5ae"). InnerVolumeSpecName "kube-api-access-7ns5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:14:54.548741 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.548695    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj4wp\" (UniqueName: \"kubernetes.io/projected/f55777a1-e360-4753-bfdb-ab2ca232566e-kube-api-access-dj4wp\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:54.548741 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.548735    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ns5j\" (UniqueName: \"kubernetes.io/projected/a854362f-6de7-4bf4-af9b-401f3493a5ae-kube-api-access-7ns5j\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:54.548741 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.548745    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a854362f-6de7-4bf4-af9b-401f3493a5ae-extensions-socket-volume\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:14:54.556210 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.556173    2552 generic.go:356] "Generic (PLEG): container finished" podID="f55777a1-e360-4753-bfdb-ab2ca232566e" containerID="cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff" exitCode=0
Jul 28 01:14:54.556327 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.556223    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.556327 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.556290    2552 scope.go:117] "RemoveContainer" containerID="cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff"
Jul 28 01:14:54.557791 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.557770    2552 generic.go:356] "Generic (PLEG): container finished" podID="a854362f-6de7-4bf4-af9b-401f3493a5ae" containerID="a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435" exitCode=0
Jul 28 01:14:54.557898 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.557881    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.558383 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.558359    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.560276 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.560256    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.562104 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.562073    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.563839 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.563817    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.566737 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.566722    2552 scope.go:117] "RemoveContainer" containerID="cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff"
Jul 28 01:14:54.567027 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.567011    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff\": container with ID starting with cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff not found: ID does not exist" containerID="cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff"
Jul 28 01:14:54.567076 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.567056    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff"} err="failed to get container status \"cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff\": rpc error: code = NotFound desc = could not find container \"cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff\": container with ID starting with cfdec4524b3d8d48c9167abee3b136e1d4d7b9f3d2878312655170f48f0ab6ff not found: ID does not exist"
Jul 28 01:14:54.567076 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.567072    2552 scope.go:117] "RemoveContainer" containerID="a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435"
Jul 28 01:14:54.567199 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.567170    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.568924 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.568894    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.570657 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.570639    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:54.572471 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.572451    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:54.575186 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.575171    2552 scope.go:117] "RemoveContainer" containerID="a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435"
Jul 28 01:14:54.575420 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:54.575404    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435\": container with ID starting with a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435 not found: ID does not exist" containerID="a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435"
Jul 28 01:14:54.575459 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.575437    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435"} err="failed to get container status \"a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435\": rpc error: code = NotFound desc = could not find container \"a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435\": container with ID starting with a0bd9ecfddf9f064e9e0091ef3635a11e6b239292282f6c0d179b71ca3981435 not found: ID does not exist"
Jul 28 01:14:54.579618 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.579599    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:14:54.585813 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.585797    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5"
Jul 28 01:14:54.730197 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.730172    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"]
Jul 28 01:14:54.732380 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:14:54.732356    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e58f4a6_e992_43d4_8337_ce59b7adecfa.slice/crio-34f0c44380420df8380ac22bd2798139d6e0ef78988c1d80b2d6012cc955868b WatchSource:0}: Error finding container 34f0c44380420df8380ac22bd2798139d6e0ef78988c1d80b2d6012cc955868b: Status 404 returned error can't find the container with id 34f0c44380420df8380ac22bd2798139d6e0ef78988c1d80b2d6012cc955868b
Jul 28 01:14:54.749396 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:54.746683    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5"]
Jul 28 01:14:54.753324 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:14:54.753300    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07dee455_ce1d_4dee_b3a0_2ef36b0b52e9.slice/crio-3e125aa311ff253e01c5f12afb87ce36e36ce2b188e0a2122b0afc8dd37c2dc6 WatchSource:0}: Error finding container 3e125aa311ff253e01c5f12afb87ce36e36ce2b188e0a2122b0afc8dd37c2dc6: Status 404 returned error can't find the container with id 3e125aa311ff253e01c5f12afb87ce36e36ce2b188e0a2122b0afc8dd37c2dc6
Jul 28 01:14:55.162457 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.162410    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:55.267301 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.267267    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:55.507409 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.507327    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-ll4mk"
Jul 28 01:14:55.527665 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:55.527625    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:55.529287 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:55.529260    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:55.568882 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.568837    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g" event={"ID":"8e58f4a6-e992-43d4-8337-ce59b7adecfa","Type":"ContainerStarted","Data":"96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349"}
Jul 28 01:14:55.569086 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.568897    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g" event={"ID":"8e58f4a6-e992-43d4-8337-ce59b7adecfa","Type":"ContainerStarted","Data":"34f0c44380420df8380ac22bd2798139d6e0ef78988c1d80b2d6012cc955868b"}
Jul 28 01:14:55.569086 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.568961    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:14:55.570679 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.570650    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5" event={"ID":"07dee455-ce1d-4dee-b3a0-2ef36b0b52e9","Type":"ContainerStarted","Data":"70876fe3dd26574feab66f3880621fd9db2d31a8fff17be78e790a8173aed3dc"}
Jul 28 01:14:55.570767 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.570706    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5" event={"ID":"07dee455-ce1d-4dee-b3a0-2ef36b0b52e9","Type":"ContainerStarted","Data":"3e125aa311ff253e01c5f12afb87ce36e36ce2b188e0a2122b0afc8dd37c2dc6"}
Jul 28 01:14:55.570767 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.570735    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5"
Jul 28 01:14:55.587702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.587653    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g" podStartSLOduration=1.587636157 podStartE2EDuration="1.587636157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:14:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:14:55.586937631 +0000 UTC m=+628.201245703" watchObservedRunningTime="2026-07-28 01:14:55.587636157 +0000 UTC m=+628.201944228"
Jul 28 01:14:55.588884 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:55.588855    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:55.590649 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:55.590625    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:55.592604 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:55.592547    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6ls4v\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6ls4v"
Jul 28 01:14:55.613320 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:14:55.613285    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7cs7q\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7cs7q"
Jul 28 01:14:55.613542 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:55.613505    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5" podStartSLOduration=1.613490835 podStartE2EDuration="1.613490835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:14:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:14:55.611530948 +0000 UTC m=+628.225839021" watchObservedRunningTime="2026-07-28 01:14:55.613490835 +0000 UTC m=+628.227798906"
Jul 28 01:14:56.022000 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:56.021967    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a854362f-6de7-4bf4-af9b-401f3493a5ae" path="/var/lib/kubelet/pods/a854362f-6de7-4bf4-af9b-401f3493a5ae/volumes"
Jul 28 01:14:56.022401 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:56.022382    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f55777a1-e360-4753-bfdb-ab2ca232566e" path="/var/lib/kubelet/pods/f55777a1-e360-4753-bfdb-ab2ca232566e/volumes"
Jul 28 01:14:59.871325 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:59.871289    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:14:59.972689 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:14:59.972656    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:03.682363 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:03.682330    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:03.783357 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:03.783327    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:06.579060 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:06.579029    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:15:06.579562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:06.579111    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-h2ld5"
Jul 28 01:15:12.366419 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:12.366383    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:12.466680 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:12.466643    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:14.806482 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:14.806448    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:14.864234 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:14.864202    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:19.562262 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:19.562230    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:19.658542 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:19.658498    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:23.762202 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:23.762157    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:23.815911 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:23.815881    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:25.091046 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.091013    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"]
Jul 28 01:15:25.091454 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.091218    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g" podUID="8e58f4a6-e992-43d4-8337-ce59b7adecfa" containerName="manager" containerID="cri-o://96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349" gracePeriod=10
Jul 28 01:15:25.345484 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.345423    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:15:25.408449 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.408418    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e58f4a6-e992-43d4-8337-ce59b7adecfa-extensions-socket-volume\") pod \"8e58f4a6-e992-43d4-8337-ce59b7adecfa\" (UID: \"8e58f4a6-e992-43d4-8337-ce59b7adecfa\") "
Jul 28 01:15:25.408613 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.408467    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7fzr\" (UniqueName: \"kubernetes.io/projected/8e58f4a6-e992-43d4-8337-ce59b7adecfa-kube-api-access-p7fzr\") pod \"8e58f4a6-e992-43d4-8337-ce59b7adecfa\" (UID: \"8e58f4a6-e992-43d4-8337-ce59b7adecfa\") "
Jul 28 01:15:25.408813 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.408789    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e58f4a6-e992-43d4-8337-ce59b7adecfa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8e58f4a6-e992-43d4-8337-ce59b7adecfa" (UID: "8e58f4a6-e992-43d4-8337-ce59b7adecfa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:15:25.410740 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.410714    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e58f4a6-e992-43d4-8337-ce59b7adecfa-kube-api-access-p7fzr" (OuterVolumeSpecName: "kube-api-access-p7fzr") pod "8e58f4a6-e992-43d4-8337-ce59b7adecfa" (UID: "8e58f4a6-e992-43d4-8337-ce59b7adecfa"). InnerVolumeSpecName "kube-api-access-p7fzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:15:25.509311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.509281    2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e58f4a6-e992-43d4-8337-ce59b7adecfa-extensions-socket-volume\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:15:25.509311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.509307    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7fzr\" (UniqueName: \"kubernetes.io/projected/8e58f4a6-e992-43d4-8337-ce59b7adecfa-kube-api-access-p7fzr\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:15:25.728173 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.728123    2552 generic.go:356] "Generic (PLEG): container finished" podID="8e58f4a6-e992-43d4-8337-ce59b7adecfa" containerID="96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349" exitCode=0
Jul 28 01:15:25.728349 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.728198    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g" event={"ID":"8e58f4a6-e992-43d4-8337-ce59b7adecfa","Type":"ContainerDied","Data":"96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349"}
Jul 28 01:15:25.728349 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.728210    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"
Jul 28 01:15:25.728349 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.728269    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g" event={"ID":"8e58f4a6-e992-43d4-8337-ce59b7adecfa","Type":"ContainerDied","Data":"34f0c44380420df8380ac22bd2798139d6e0ef78988c1d80b2d6012cc955868b"}
Jul 28 01:15:25.728349 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.728291    2552 scope.go:117] "RemoveContainer" containerID="96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349"
Jul 28 01:15:25.740650 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.740629    2552 scope.go:117] "RemoveContainer" containerID="96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349"
Jul 28 01:15:25.740976 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:15:25.740951    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349\": container with ID starting with 96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349 not found: ID does not exist" containerID="96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349"
Jul 28 01:15:25.741053 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.740990    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349"} err="failed to get container status \"96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349\": rpc error: code = NotFound desc = could not find container \"96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349\": container with ID starting with 96f93e167b664605f413e81f234ea5afd36f3d2f7af1040e7a6b54b70509d349 not found: ID does not exist"
Jul 28 01:15:25.754498 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.754473    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"]
Jul 28 01:15:25.758068 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:25.758044    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gq29g"]
Jul 28 01:15:26.022025 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:26.021940    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e58f4a6-e992-43d4-8337-ce59b7adecfa" path="/var/lib/kubelet/pods/8e58f4a6-e992-43d4-8337-ce59b7adecfa/volumes"
Jul 28 01:15:32.768082 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:32.768049    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:32.902546 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:32.902513    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:35.288390 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:35.288361    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:35.388328 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:35.388290    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:35.987339 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:35.987304    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:36.035938 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:36.035905    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:38.521790 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:38.521742    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:39.977683 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:39.977651    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:40.080452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:40.080417    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:41.345895 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.345862    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"]
Jul 28 01:15:41.346292 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.346240    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e58f4a6-e992-43d4-8337-ce59b7adecfa" containerName="manager"
Jul 28 01:15:41.346292 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.346252    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e58f4a6-e992-43d4-8337-ce59b7adecfa" containerName="manager"
Jul 28 01:15:41.346362 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.346328    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e58f4a6-e992-43d4-8337-ce59b7adecfa" containerName="manager"
Jul 28 01:15:41.349321 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.349304    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.351528 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.351512    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7bj5k\""
Jul 28 01:15:41.358991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.358965    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"]
Jul 28 01:15:41.368462 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.368438    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:41.444544 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.444503    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.444544 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.444553    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.444775 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.444639    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpvg5\" (UniqueName: \"kubernetes.io/projected/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-kube-api-access-fpvg5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.444775 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.444677    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.444775 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.444696    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.444775 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.444750    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.444983 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.444781    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.444983 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.444830    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.444983 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.444878    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.464944 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.464910    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:41.545378 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.545342    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.545538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.545388    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.545538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.545416    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.545538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.545445    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.545538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.545477    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.545538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.545510    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.545753 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.545564    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpvg5\" (UniqueName: \"kubernetes.io/projected/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-kube-api-access-fpvg5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.545753 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.545598    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.545753 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.545619    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.545868 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.545775    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.546110 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.546078    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.546110 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.546099    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.546336 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.546302    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.546484 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.546463    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.548030 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.548010    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.548160 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.548103    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.553531 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.553511    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.553638 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.553547    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpvg5\" (UniqueName: \"kubernetes.io/projected/8328a25c-7f2b-48bd-a2aa-77de4de41a1d-kube-api-access-fpvg5\") pod \"maas-default-gateway-openshift-default-78bb78ff78-zp4fd\" (UID: \"8328a25c-7f2b-48bd-a2aa-77de4de41a1d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.660646 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.660602    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:41.797012 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.796988    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"]
Jul 28 01:15:41.799635 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:15:41.799603    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8328a25c_7f2b_48bd_a2aa_77de4de41a1d.slice/crio-424d78f83e6fdbaa5e3d162ed4d41bc6355e3634b56475bb5743d5e743e72b5a WatchSource:0}: Error finding container 424d78f83e6fdbaa5e3d162ed4d41bc6355e3634b56475bb5743d5e743e72b5a: Status 404 returned error can't find the container with id 424d78f83e6fdbaa5e3d162ed4d41bc6355e3634b56475bb5743d5e743e72b5a
Jul 28 01:15:41.801854 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.801816    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:15:41.801923 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.801900    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:15:41.801964 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.801936    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:15:41.808073 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:41.808050    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd" event={"ID":"8328a25c-7f2b-48bd-a2aa-77de4de41a1d","Type":"ContainerStarted","Data":"424d78f83e6fdbaa5e3d162ed4d41bc6355e3634b56475bb5743d5e743e72b5a"}
Jul 28 01:15:42.821625 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:42.821588    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd" event={"ID":"8328a25c-7f2b-48bd-a2aa-77de4de41a1d","Type":"ContainerStarted","Data":"428ccbea25f2151ccb2c9dcbf09863a95acb7c552364772397ebd8b9da6daaa7"}
Jul 28 01:15:42.841194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:42.841116    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd" podStartSLOduration=1.8410961750000001 podStartE2EDuration="1.841096175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:42.838453972 +0000 UTC m=+675.452762057" watchObservedRunningTime="2026-07-28 01:15:42.841096175 +0000 UTC m=+675.455404248"
Jul 28 01:15:43.661398 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:43.661365    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:43.666048 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:43.666023    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:43.826595 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:43.826560    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:43.827647 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:43.827624    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:15:44.136574 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.136547    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:44.138085 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.138060    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"]
Jul 28 01:15:44.141002 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.140984    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:15:44.144183 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.144166    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 28 01:15:44.144283 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.144227    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8k9rr\""
Jul 28 01:15:44.162786 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.162761    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"]
Jul 28 01:15:44.243588 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.243552    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"]
Jul 28 01:15:44.260977 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.260947    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:44.270278 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.270252    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-config-file\") pod \"limitador-limitador-64c94fd64f-tlrfg\" (UID: \"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:15:44.270415 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.270293    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cgmd\" (UniqueName: \"kubernetes.io/projected/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-kube-api-access-2cgmd\") pod \"limitador-limitador-64c94fd64f-tlrfg\" (UID: \"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:15:44.361443 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.361407    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:44.371312 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.371271    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-config-file\") pod \"limitador-limitador-64c94fd64f-tlrfg\" (UID: \"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:15:44.371498 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.371324    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cgmd\" (UniqueName: \"kubernetes.io/projected/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-kube-api-access-2cgmd\") pod \"limitador-limitador-64c94fd64f-tlrfg\" (UID: \"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:15:44.371942 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.371924    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-config-file\") pod \"limitador-limitador-64c94fd64f-tlrfg\" (UID: \"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:15:44.379574 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.379550    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cgmd\" (UniqueName: \"kubernetes.io/projected/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-kube-api-access-2cgmd\") pod \"limitador-limitador-64c94fd64f-tlrfg\" (UID: \"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:15:44.451670 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.451584    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:15:44.590645 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.590619    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"]
Jul 28 01:15:44.592293 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:15:44.592262    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ec2bad_0a16_4c31_8c6d_ba4e31900c65.slice/crio-d165280df888da9b3d6a967ae5ec2b11bd606f061d0df08ee37d4c6862dec0f1 WatchSource:0}: Error finding container d165280df888da9b3d6a967ae5ec2b11bd606f061d0df08ee37d4c6862dec0f1: Status 404 returned error can't find the container with id d165280df888da9b3d6a967ae5ec2b11bd606f061d0df08ee37d4c6862dec0f1
Jul 28 01:15:44.833540 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.833452    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg" event={"ID":"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65","Type":"ContainerStarted","Data":"d165280df888da9b3d6a967ae5ec2b11bd606f061d0df08ee37d4c6862dec0f1"}
Jul 28 01:15:44.948112 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.948078    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qjcxk"]
Jul 28 01:15:44.951702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.951680    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qjcxk"
Jul 28 01:15:44.953845 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.953822    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x9rwp\""
Jul 28 01:15:44.957627 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.957603    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qjcxk"]
Jul 28 01:15:44.977094 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:44.977068    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:45.033880 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.033853    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:15:45.062107 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.062075    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-9zctw"]
Jul 28 01:15:45.064749 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.064734    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9zctw"
Jul 28 01:15:45.069585 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.069559    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9zctw"]
Jul 28 01:15:45.077524 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.077485    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x74b\" (UniqueName: \"kubernetes.io/projected/bad7160c-2b4f-440b-b91c-15f3fc88b4c7-kube-api-access-5x74b\") pod \"authorino-58cd955675-qjcxk\" (UID: \"bad7160c-2b4f-440b-b91c-15f3fc88b4c7\") " pod="kuadrant-system/authorino-58cd955675-qjcxk"
Jul 28 01:15:45.178805 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.178770    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrl42\" (UniqueName: \"kubernetes.io/projected/05e76fce-9d0d-4739-8e2f-c9ff10d17333-kube-api-access-hrl42\") pod \"authorino-75d556bd77-9zctw\" (UID: \"05e76fce-9d0d-4739-8e2f-c9ff10d17333\") " pod="kuadrant-system/authorino-75d556bd77-9zctw"
Jul 28 01:15:45.178999 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.178816    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x74b\" (UniqueName: \"kubernetes.io/projected/bad7160c-2b4f-440b-b91c-15f3fc88b4c7-kube-api-access-5x74b\") pod \"authorino-58cd955675-qjcxk\" (UID: \"bad7160c-2b4f-440b-b91c-15f3fc88b4c7\") " pod="kuadrant-system/authorino-58cd955675-qjcxk"
Jul 28 01:15:45.186364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.186333    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x74b\" (UniqueName: \"kubernetes.io/projected/bad7160c-2b4f-440b-b91c-15f3fc88b4c7-kube-api-access-5x74b\") pod \"authorino-58cd955675-qjcxk\" (UID: \"bad7160c-2b4f-440b-b91c-15f3fc88b4c7\") " pod="kuadrant-system/authorino-58cd955675-qjcxk"
Jul 28 01:15:45.262694 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.262657    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qjcxk"
Jul 28 01:15:45.280043 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.280012    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrl42\" (UniqueName: \"kubernetes.io/projected/05e76fce-9d0d-4739-8e2f-c9ff10d17333-kube-api-access-hrl42\") pod \"authorino-75d556bd77-9zctw\" (UID: \"05e76fce-9d0d-4739-8e2f-c9ff10d17333\") " pod="kuadrant-system/authorino-75d556bd77-9zctw"
Jul 28 01:15:45.291733 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.291700    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrl42\" (UniqueName: \"kubernetes.io/projected/05e76fce-9d0d-4739-8e2f-c9ff10d17333-kube-api-access-hrl42\") pod \"authorino-75d556bd77-9zctw\" (UID: \"05e76fce-9d0d-4739-8e2f-c9ff10d17333\") " pod="kuadrant-system/authorino-75d556bd77-9zctw"
Jul 28 01:15:45.375427 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.375189    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9zctw"
Jul 28 01:15:45.413227 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.413049    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qjcxk"]
Jul 28 01:15:45.559414 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.559342    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9zctw"]
Jul 28 01:15:45.845990 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.845898    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qjcxk" event={"ID":"bad7160c-2b4f-440b-b91c-15f3fc88b4c7","Type":"ContainerStarted","Data":"7425348ce389b6d66efad6dcce29301c31790cef5cca46742747f450c8c9cce9"}
Jul 28 01:15:45.847296 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:45.847268    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9zctw" event={"ID":"05e76fce-9d0d-4739-8e2f-c9ff10d17333","Type":"ContainerStarted","Data":"98de745867576dffa84e1a5fbf69bdcdb317ef37f3dc45e15315c3943f2faec0"}
Jul 28 01:15:50.906726 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:50.906688    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qjcxk" event={"ID":"bad7160c-2b4f-440b-b91c-15f3fc88b4c7","Type":"ContainerStarted","Data":"c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f"}
Jul 28 01:15:50.908142 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:50.908104    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg" event={"ID":"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65","Type":"ContainerStarted","Data":"af261048faf8af31675094b62a5e80ee5f595f4bf61b9834e9d85a50e955796d"}
Jul 28 01:15:50.908276 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:50.908180    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:15:50.909610 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:50.909591    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9zctw" event={"ID":"05e76fce-9d0d-4739-8e2f-c9ff10d17333","Type":"ContainerStarted","Data":"4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418"}
Jul 28 01:15:50.920682 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:50.920644    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qjcxk" podStartSLOduration=2.475791142 podStartE2EDuration="6.920631734s" totalImagesPullingTime="4.444840592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:50.91925853 +0000 UTC m=+683.533566602" watchObservedRunningTime="2026-07-28 01:15:50.920631734 +0000 UTC m=+683.534939806"
Jul 28 01:15:50.935042 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:50.934980    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg" podStartSLOduration=1.62542242 podStartE2EDuration="6.93496017s" totalImagesPullingTime="5.30953775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:50.934552262 +0000 UTC m=+683.548860337" watchObservedRunningTime="2026-07-28 01:15:50.93496017 +0000 UTC m=+683.549268245"
Jul 28 01:15:50.976049 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:50.975992    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-9zctw" podStartSLOduration=1.644097583 podStartE2EDuration="5.975969389s" totalImagesPullingTime="4.331871806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:15:50.949925525 +0000 UTC m=+683.564233598" watchObservedRunningTime="2026-07-28 01:15:50.975969389 +0000 UTC m=+683.590277462"
Jul 28 01:15:50.976709 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:50.976682    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qjcxk"]
Jul 28 01:15:52.919702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:52.919652    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qjcxk" podUID="bad7160c-2b4f-440b-b91c-15f3fc88b4c7" containerName="authorino" containerID="cri-o://c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f" gracePeriod=30
Jul 28 01:15:53.173520 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.173456    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qjcxk"
Jul 28 01:15:53.357183 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.357119    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x74b\" (UniqueName: \"kubernetes.io/projected/bad7160c-2b4f-440b-b91c-15f3fc88b4c7-kube-api-access-5x74b\") pod \"bad7160c-2b4f-440b-b91c-15f3fc88b4c7\" (UID: \"bad7160c-2b4f-440b-b91c-15f3fc88b4c7\") "
Jul 28 01:15:53.359390 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.359354    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bad7160c-2b4f-440b-b91c-15f3fc88b4c7-kube-api-access-5x74b" (OuterVolumeSpecName: "kube-api-access-5x74b") pod "bad7160c-2b4f-440b-b91c-15f3fc88b4c7" (UID: "bad7160c-2b4f-440b-b91c-15f3fc88b4c7"). InnerVolumeSpecName "kube-api-access-5x74b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:15:53.458451 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.458368    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x74b\" (UniqueName: \"kubernetes.io/projected/bad7160c-2b4f-440b-b91c-15f3fc88b4c7-kube-api-access-5x74b\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:15:53.926031 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.925992    2552 generic.go:356] "Generic (PLEG): container finished" podID="bad7160c-2b4f-440b-b91c-15f3fc88b4c7" containerID="c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f" exitCode=0
Jul 28 01:15:53.926475 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.926048    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qjcxk"
Jul 28 01:15:53.926475 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.926080    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qjcxk" event={"ID":"bad7160c-2b4f-440b-b91c-15f3fc88b4c7","Type":"ContainerDied","Data":"c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f"}
Jul 28 01:15:53.926475 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.926125    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qjcxk" event={"ID":"bad7160c-2b4f-440b-b91c-15f3fc88b4c7","Type":"ContainerDied","Data":"7425348ce389b6d66efad6dcce29301c31790cef5cca46742747f450c8c9cce9"}
Jul 28 01:15:53.926475 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.926164    2552 scope.go:117] "RemoveContainer" containerID="c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f"
Jul 28 01:15:53.936275 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.936254    2552 scope.go:117] "RemoveContainer" containerID="c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f"
Jul 28 01:15:53.936542 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:15:53.936523    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f\": container with ID starting with c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f not found: ID does not exist" containerID="c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f"
Jul 28 01:15:53.936583 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.936549    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f"} err="failed to get container status \"c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f\": rpc error: code = NotFound desc = could not find container \"c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f\": container with ID starting with c2201acff9108a3ee259a0dd413b505cf63514b852905911a68e42ca6c7dd18f not found: ID does not exist"
Jul 28 01:15:53.948644 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.948617    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qjcxk"]
Jul 28 01:15:53.955229 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:53.955206    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qjcxk"]
Jul 28 01:15:54.021818 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:54.021786    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bad7160c-2b4f-440b-b91c-15f3fc88b4c7" path="/var/lib/kubelet/pods/bad7160c-2b4f-440b-b91c-15f3fc88b4c7/volumes"
Jul 28 01:15:59.418030 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:59.417991    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"]
Jul 28 01:15:59.418632 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:59.418266    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg" podUID="b8ec2bad-0a16-4c31-8c6d-ba4e31900c65" containerName="limitador" containerID="cri-o://af261048faf8af31675094b62a5e80ee5f595f4bf61b9834e9d85a50e955796d" gracePeriod=30
Jul 28 01:15:59.419024 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:59.418959    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:15:59.959884 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:59.959849    2552 generic.go:356] "Generic (PLEG): container finished" podID="b8ec2bad-0a16-4c31-8c6d-ba4e31900c65" containerID="af261048faf8af31675094b62a5e80ee5f595f4bf61b9834e9d85a50e955796d" exitCode=0
Jul 28 01:15:59.960062 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:59.959936    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg" event={"ID":"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65","Type":"ContainerDied","Data":"af261048faf8af31675094b62a5e80ee5f595f4bf61b9834e9d85a50e955796d"}
Jul 28 01:15:59.983299 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:15:59.983246    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:16:00.007057 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.007030    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cgmd\" (UniqueName: \"kubernetes.io/projected/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-kube-api-access-2cgmd\") pod \"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65\" (UID: \"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65\") "
Jul 28 01:16:00.007243 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.007098    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-config-file\") pod \"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65\" (UID: \"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65\") "
Jul 28 01:16:00.007406 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.007385    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-config-file" (OuterVolumeSpecName: "config-file") pod "b8ec2bad-0a16-4c31-8c6d-ba4e31900c65" (UID: "b8ec2bad-0a16-4c31-8c6d-ba4e31900c65"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:16:00.009271 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.009250    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-kube-api-access-2cgmd" (OuterVolumeSpecName: "kube-api-access-2cgmd") pod "b8ec2bad-0a16-4c31-8c6d-ba4e31900c65" (UID: "b8ec2bad-0a16-4c31-8c6d-ba4e31900c65"). InnerVolumeSpecName "kube-api-access-2cgmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:16:00.108763 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.108729    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cgmd\" (UniqueName: \"kubernetes.io/projected/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-kube-api-access-2cgmd\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:16:00.109016 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.108993    2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65-config-file\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:16:00.966731 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.966701    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg" event={"ID":"b8ec2bad-0a16-4c31-8c6d-ba4e31900c65","Type":"ContainerDied","Data":"d165280df888da9b3d6a967ae5ec2b11bd606f061d0df08ee37d4c6862dec0f1"}
Jul 28 01:16:00.966731 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.966718    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"
Jul 28 01:16:00.967240 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.966767    2552 scope.go:117] "RemoveContainer" containerID="af261048faf8af31675094b62a5e80ee5f595f4bf61b9834e9d85a50e955796d"
Jul 28 01:16:00.982380 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.982352    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"]
Jul 28 01:16:00.985607 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:00.985585    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlrfg"]
Jul 28 01:16:02.022254 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:02.022222    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ec2bad-0a16-4c31-8c6d-ba4e31900c65" path="/var/lib/kubelet/pods/b8ec2bad-0a16-4c31-8c6d-ba4e31900c65/volumes"
Jul 28 01:16:05.001805 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.001774    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:05.097305 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.097265    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:05.417186 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.417152    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"]
Jul 28 01:16:05.417556 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.417543    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ec2bad-0a16-4c31-8c6d-ba4e31900c65" containerName="limitador"
Jul 28 01:16:05.417630 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.417557    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ec2bad-0a16-4c31-8c6d-ba4e31900c65" containerName="limitador"
Jul 28 01:16:05.417630 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.417569    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad7160c-2b4f-440b-b91c-15f3fc88b4c7" containerName="authorino"
Jul 28 01:16:05.417630 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.417575    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad7160c-2b4f-440b-b91c-15f3fc88b4c7" containerName="authorino"
Jul 28 01:16:05.417787 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.417636    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ec2bad-0a16-4c31-8c6d-ba4e31900c65" containerName="limitador"
Jul 28 01:16:05.417787 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.417645    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="bad7160c-2b4f-440b-b91c-15f3fc88b4c7" containerName="authorino"
Jul 28 01:16:05.422338 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.422313    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"
Jul 28 01:16:05.424786 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.424752    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 28 01:16:05.424786 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.424771    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 28 01:16:05.425779 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.425759    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9p6qz\""
Jul 28 01:16:05.426062 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.425761    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 01:16:05.428605 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.428578    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"]
Jul 28 01:16:05.455830 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.455799    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/09c77ebf-4e15-4580-9aa3-01fec73672f6-data\") pod \"postgres-69fb4594cf-c57j6\" (UID: \"09c77ebf-4e15-4580-9aa3-01fec73672f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"
Jul 28 01:16:05.455963 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.455853    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmvnl\" (UniqueName: \"kubernetes.io/projected/09c77ebf-4e15-4580-9aa3-01fec73672f6-kube-api-access-xmvnl\") pod \"postgres-69fb4594cf-c57j6\" (UID: \"09c77ebf-4e15-4580-9aa3-01fec73672f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"
Jul 28 01:16:05.456122 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.456106    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:05.557150 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.557095    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/09c77ebf-4e15-4580-9aa3-01fec73672f6-data\") pod \"postgres-69fb4594cf-c57j6\" (UID: \"09c77ebf-4e15-4580-9aa3-01fec73672f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"
Jul 28 01:16:05.557387 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.557162    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmvnl\" (UniqueName: \"kubernetes.io/projected/09c77ebf-4e15-4580-9aa3-01fec73672f6-kube-api-access-xmvnl\") pod \"postgres-69fb4594cf-c57j6\" (UID: \"09c77ebf-4e15-4580-9aa3-01fec73672f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"
Jul 28 01:16:05.557469 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.557449    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/09c77ebf-4e15-4580-9aa3-01fec73672f6-data\") pod \"postgres-69fb4594cf-c57j6\" (UID: \"09c77ebf-4e15-4580-9aa3-01fec73672f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"
Jul 28 01:16:05.565070 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.565047    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmvnl\" (UniqueName: \"kubernetes.io/projected/09c77ebf-4e15-4580-9aa3-01fec73672f6-kube-api-access-xmvnl\") pod \"postgres-69fb4594cf-c57j6\" (UID: \"09c77ebf-4e15-4580-9aa3-01fec73672f6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"
Jul 28 01:16:05.735249 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.735099    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"
Jul 28 01:16:05.863433 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.863412    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"]
Jul 28 01:16:05.865331 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:16:05.865297    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c77ebf_4e15_4580_9aa3_01fec73672f6.slice/crio-5c33ff71e7fd8486f24c7dcff1b9b25cbfac1d55e8294c0c8be18ed19d02783f WatchSource:0}: Error finding container 5c33ff71e7fd8486f24c7dcff1b9b25cbfac1d55e8294c0c8be18ed19d02783f: Status 404 returned error can't find the container with id 5c33ff71e7fd8486f24c7dcff1b9b25cbfac1d55e8294c0c8be18ed19d02783f
Jul 28 01:16:05.866807 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.866788    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:16:05.994120 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:05.994040    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6" event={"ID":"09c77ebf-4e15-4580-9aa3-01fec73672f6","Type":"ContainerStarted","Data":"5c33ff71e7fd8486f24c7dcff1b9b25cbfac1d55e8294c0c8be18ed19d02783f"}
Jul 28 01:16:11.029985 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:11.029951    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6" event={"ID":"09c77ebf-4e15-4580-9aa3-01fec73672f6","Type":"ContainerStarted","Data":"7a6a4701297acd1038ebefb4a57e743134fd8ac336ed2f07605a480d80106a83"}
Jul 28 01:16:11.030399 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:11.030038    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"
Jul 28 01:16:11.046185 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:11.046116    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6" podStartSLOduration=1.086313946 podStartE2EDuration="6.046103446s" totalImagesPullingTime="4.9597895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:11.044157483 +0000 UTC m=+703.658465555" watchObservedRunningTime="2026-07-28 01:16:11.046103446 +0000 UTC m=+703.660411547"
Jul 28 01:16:17.064379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.064349    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-c57j6"
Jul 28 01:16:17.372629 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.372538    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:17.585893 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.585799    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbh22"]
Jul 28 01:16:17.593094 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.593065    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rbh22"
Jul 28 01:16:17.593962 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.593935    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbh22"]
Jul 28 01:16:17.639333 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.639290    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:17.667716 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.667676    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xsr5\" (UniqueName: \"kubernetes.io/projected/0094af81-4445-4668-b722-6654191eb3ca-kube-api-access-4xsr5\") pod \"authorino-5d4b67c446-rbh22\" (UID: \"0094af81-4445-4668-b722-6654191eb3ca\") " pod="kuadrant-system/authorino-5d4b67c446-rbh22"
Jul 28 01:16:17.769216 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.769175    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xsr5\" (UniqueName: \"kubernetes.io/projected/0094af81-4445-4668-b722-6654191eb3ca-kube-api-access-4xsr5\") pod \"authorino-5d4b67c446-rbh22\" (UID: \"0094af81-4445-4668-b722-6654191eb3ca\") " pod="kuadrant-system/authorino-5d4b67c446-rbh22"
Jul 28 01:16:17.777488 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.777461    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xsr5\" (UniqueName: \"kubernetes.io/projected/0094af81-4445-4668-b722-6654191eb3ca-kube-api-access-4xsr5\") pod \"authorino-5d4b67c446-rbh22\" (UID: \"0094af81-4445-4668-b722-6654191eb3ca\") " pod="kuadrant-system/authorino-5d4b67c446-rbh22"
Jul 28 01:16:17.815328 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.815290    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbh22"]
Jul 28 01:16:17.815598 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.815585    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rbh22"
Jul 28 01:16:17.843063 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.843034    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c557b88b8-v7msw"]
Jul 28 01:16:17.848378 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.848355    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c557b88b8-v7msw"
Jul 28 01:16:17.857241 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.857190    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c557b88b8-v7msw"]
Jul 28 01:16:17.904215 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.904125    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c557b88b8-v7msw"]
Jul 28 01:16:17.904453 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:16:17.904433    2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9h77g], unattached volumes=[], failed to process volumes=[kube-api-access-9h77g]: context canceled" pod="kuadrant-system/authorino-5c557b88b8-v7msw" podUID="1d949227-0cef-461a-bd03-61106e993da5"
Jul 28 01:16:17.929630 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.929598    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-795864b7f6-4sqn7"]
Jul 28 01:16:17.933903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.933580    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795864b7f6-4sqn7"
Jul 28 01:16:17.936333 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.936254    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 28 01:16:17.941541 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.941511    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795864b7f6-4sqn7"]
Jul 28 01:16:17.971370 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.971334    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h77g\" (UniqueName: \"kubernetes.io/projected/1d949227-0cef-461a-bd03-61106e993da5-kube-api-access-9h77g\") pod \"authorino-5c557b88b8-v7msw\" (UID: \"1d949227-0cef-461a-bd03-61106e993da5\") " pod="kuadrant-system/authorino-5c557b88b8-v7msw"
Jul 28 01:16:17.988167 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:17.988103    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbh22"]
Jul 28 01:16:17.989737 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:16:17.989711    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0094af81_4445_4668_b722_6654191eb3ca.slice/crio-32e967c1bd91172318a8a385689af9d75a83e4d17ad71a42bbba83cfa701e09c WatchSource:0}: Error finding container 32e967c1bd91172318a8a385689af9d75a83e4d17ad71a42bbba83cfa701e09c: Status 404 returned error can't find the container with id 32e967c1bd91172318a8a385689af9d75a83e4d17ad71a42bbba83cfa701e09c
Jul 28 01:16:18.067202 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.067164    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rbh22" event={"ID":"0094af81-4445-4668-b722-6654191eb3ca","Type":"ContainerStarted","Data":"32e967c1bd91172318a8a385689af9d75a83e4d17ad71a42bbba83cfa701e09c"}
Jul 28 01:16:18.067695 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.067273    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c557b88b8-v7msw"
Jul 28 01:16:18.071958 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.071928    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl7fq\" (UniqueName: \"kubernetes.io/projected/4fd59d28-9245-45fa-8f0f-9787836efbc5-kube-api-access-bl7fq\") pod \"authorino-795864b7f6-4sqn7\" (UID: \"4fd59d28-9245-45fa-8f0f-9787836efbc5\") " pod="kuadrant-system/authorino-795864b7f6-4sqn7"
Jul 28 01:16:18.072106 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.071980    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fd59d28-9245-45fa-8f0f-9787836efbc5-tls-cert\") pod \"authorino-795864b7f6-4sqn7\" (UID: \"4fd59d28-9245-45fa-8f0f-9787836efbc5\") " pod="kuadrant-system/authorino-795864b7f6-4sqn7"
Jul 28 01:16:18.072106 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.072079    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h77g\" (UniqueName: \"kubernetes.io/projected/1d949227-0cef-461a-bd03-61106e993da5-kube-api-access-9h77g\") pod \"authorino-5c557b88b8-v7msw\" (UID: \"1d949227-0cef-461a-bd03-61106e993da5\") " pod="kuadrant-system/authorino-5c557b88b8-v7msw"
Jul 28 01:16:18.075121 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.075101    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c557b88b8-v7msw"
Jul 28 01:16:18.079291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.079263    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h77g\" (UniqueName: \"kubernetes.io/projected/1d949227-0cef-461a-bd03-61106e993da5-kube-api-access-9h77g\") pod \"authorino-5c557b88b8-v7msw\" (UID: \"1d949227-0cef-461a-bd03-61106e993da5\") " pod="kuadrant-system/authorino-5c557b88b8-v7msw"
Jul 28 01:16:18.173040 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.172954    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9h77g\" (UniqueName: \"kubernetes.io/projected/1d949227-0cef-461a-bd03-61106e993da5-kube-api-access-9h77g\") pod \"1d949227-0cef-461a-bd03-61106e993da5\" (UID: \"1d949227-0cef-461a-bd03-61106e993da5\") "
Jul 28 01:16:18.173213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.173175    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl7fq\" (UniqueName: \"kubernetes.io/projected/4fd59d28-9245-45fa-8f0f-9787836efbc5-kube-api-access-bl7fq\") pod \"authorino-795864b7f6-4sqn7\" (UID: \"4fd59d28-9245-45fa-8f0f-9787836efbc5\") " pod="kuadrant-system/authorino-795864b7f6-4sqn7"
Jul 28 01:16:18.173274 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.173219    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fd59d28-9245-45fa-8f0f-9787836efbc5-tls-cert\") pod \"authorino-795864b7f6-4sqn7\" (UID: \"4fd59d28-9245-45fa-8f0f-9787836efbc5\") " pod="kuadrant-system/authorino-795864b7f6-4sqn7"
Jul 28 01:16:18.175221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.175196    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d949227-0cef-461a-bd03-61106e993da5-kube-api-access-9h77g" (OuterVolumeSpecName: "kube-api-access-9h77g") pod "1d949227-0cef-461a-bd03-61106e993da5" (UID: "1d949227-0cef-461a-bd03-61106e993da5"). InnerVolumeSpecName "kube-api-access-9h77g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:16:18.175638 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.175621    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fd59d28-9245-45fa-8f0f-9787836efbc5-tls-cert\") pod \"authorino-795864b7f6-4sqn7\" (UID: \"4fd59d28-9245-45fa-8f0f-9787836efbc5\") " pod="kuadrant-system/authorino-795864b7f6-4sqn7"
Jul 28 01:16:18.180125 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.180107    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl7fq\" (UniqueName: \"kubernetes.io/projected/4fd59d28-9245-45fa-8f0f-9787836efbc5-kube-api-access-bl7fq\") pod \"authorino-795864b7f6-4sqn7\" (UID: \"4fd59d28-9245-45fa-8f0f-9787836efbc5\") " pod="kuadrant-system/authorino-795864b7f6-4sqn7"
Jul 28 01:16:18.245305 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.245274    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795864b7f6-4sqn7"
Jul 28 01:16:18.273891 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.273863    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9h77g\" (UniqueName: \"kubernetes.io/projected/1d949227-0cef-461a-bd03-61106e993da5-kube-api-access-9h77g\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:16:18.379827 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:18.379796    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795864b7f6-4sqn7"]
Jul 28 01:16:18.380761 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:16:18.380735    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fd59d28_9245_45fa_8f0f_9787836efbc5.slice/crio-c87e450f3060b539ad468cf93837774d3ff9ac527217dadbafe1c33c7179b82f WatchSource:0}: Error finding container c87e450f3060b539ad468cf93837774d3ff9ac527217dadbafe1c33c7179b82f: Status 404 returned error can't find the container with id c87e450f3060b539ad468cf93837774d3ff9ac527217dadbafe1c33c7179b82f
Jul 28 01:16:19.073756 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.073650    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-rbh22" podUID="0094af81-4445-4668-b722-6654191eb3ca" containerName="authorino" containerID="cri-o://3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944" gracePeriod=30
Jul 28 01:16:19.073756 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.073651    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rbh22" event={"ID":"0094af81-4445-4668-b722-6654191eb3ca","Type":"ContainerStarted","Data":"3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944"}
Jul 28 01:16:19.075242 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.075213    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795864b7f6-4sqn7" event={"ID":"4fd59d28-9245-45fa-8f0f-9787836efbc5","Type":"ContainerStarted","Data":"a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f"}
Jul 28 01:16:19.075378 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.075247    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795864b7f6-4sqn7" event={"ID":"4fd59d28-9245-45fa-8f0f-9787836efbc5","Type":"ContainerStarted","Data":"c87e450f3060b539ad468cf93837774d3ff9ac527217dadbafe1c33c7179b82f"}
Jul 28 01:16:19.075378 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.075282    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c557b88b8-v7msw"
Jul 28 01:16:19.089402 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.089363    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-rbh22" podStartSLOduration=1.6882208539999999 podStartE2EDuration="2.089349657s" totalImagesPullingTime="401.128803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:19.086967107 +0000 UTC m=+711.701275189" watchObservedRunningTime="2026-07-28 01:16:19.089349657 +0000 UTC m=+711.703657729"
Jul 28 01:16:19.102723 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.102677    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-795864b7f6-4sqn7" podStartSLOduration=1.715873952 podStartE2EDuration="2.102663309s" totalImagesPullingTime="386.789357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:19.100608976 +0000 UTC m=+711.714917049" watchObservedRunningTime="2026-07-28 01:16:19.102663309 +0000 UTC m=+711.716971380"
Jul 28 01:16:19.126114 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.126078    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c557b88b8-v7msw"]
Jul 28 01:16:19.132768 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.132743    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9zctw"]
Jul 28 01:16:19.132930 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.132907    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-9zctw" podUID="05e76fce-9d0d-4739-8e2f-c9ff10d17333" containerName="authorino" containerID="cri-o://4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418" gracePeriod=30
Jul 28 01:16:19.137290 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.137267    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c557b88b8-v7msw"]
Jul 28 01:16:19.394908 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.394888    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rbh22"
Jul 28 01:16:19.397660 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.397641    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9zctw"
Jul 28 01:16:19.484425 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.484396    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xsr5\" (UniqueName: \"kubernetes.io/projected/0094af81-4445-4668-b722-6654191eb3ca-kube-api-access-4xsr5\") pod \"0094af81-4445-4668-b722-6654191eb3ca\" (UID: \"0094af81-4445-4668-b722-6654191eb3ca\") "
Jul 28 01:16:19.484425 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.484430    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrl42\" (UniqueName: \"kubernetes.io/projected/05e76fce-9d0d-4739-8e2f-c9ff10d17333-kube-api-access-hrl42\") pod \"05e76fce-9d0d-4739-8e2f-c9ff10d17333\" (UID: \"05e76fce-9d0d-4739-8e2f-c9ff10d17333\") "
Jul 28 01:16:19.486605 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.486579    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0094af81-4445-4668-b722-6654191eb3ca-kube-api-access-4xsr5" (OuterVolumeSpecName: "kube-api-access-4xsr5") pod "0094af81-4445-4668-b722-6654191eb3ca" (UID: "0094af81-4445-4668-b722-6654191eb3ca"). InnerVolumeSpecName "kube-api-access-4xsr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:16:19.486605 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.486586    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e76fce-9d0d-4739-8e2f-c9ff10d17333-kube-api-access-hrl42" (OuterVolumeSpecName: "kube-api-access-hrl42") pod "05e76fce-9d0d-4739-8e2f-c9ff10d17333" (UID: "05e76fce-9d0d-4739-8e2f-c9ff10d17333"). InnerVolumeSpecName "kube-api-access-hrl42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:16:19.585787 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.585710    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xsr5\" (UniqueName: \"kubernetes.io/projected/0094af81-4445-4668-b722-6654191eb3ca-kube-api-access-4xsr5\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:16:19.585787 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:19.585735    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrl42\" (UniqueName: \"kubernetes.io/projected/05e76fce-9d0d-4739-8e2f-c9ff10d17333-kube-api-access-hrl42\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:16:20.021492 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.021458    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d949227-0cef-461a-bd03-61106e993da5" path="/var/lib/kubelet/pods/1d949227-0cef-461a-bd03-61106e993da5/volumes"
Jul 28 01:16:20.081572 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.081532    2552 generic.go:356] "Generic (PLEG): container finished" podID="05e76fce-9d0d-4739-8e2f-c9ff10d17333" containerID="4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418" exitCode=0
Jul 28 01:16:20.081937 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.081578    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9zctw"
Jul 28 01:16:20.081937 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.081618    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9zctw" event={"ID":"05e76fce-9d0d-4739-8e2f-c9ff10d17333","Type":"ContainerDied","Data":"4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418"}
Jul 28 01:16:20.081937 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.081666    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9zctw" event={"ID":"05e76fce-9d0d-4739-8e2f-c9ff10d17333","Type":"ContainerDied","Data":"98de745867576dffa84e1a5fbf69bdcdb317ef37f3dc45e15315c3943f2faec0"}
Jul 28 01:16:20.081937 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.081686    2552 scope.go:117] "RemoveContainer" containerID="4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418"
Jul 28 01:16:20.083103 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.083083    2552 generic.go:356] "Generic (PLEG): container finished" podID="0094af81-4445-4668-b722-6654191eb3ca" containerID="3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944" exitCode=0
Jul 28 01:16:20.083223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.083156    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rbh22"
Jul 28 01:16:20.083223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.083165    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rbh22" event={"ID":"0094af81-4445-4668-b722-6654191eb3ca","Type":"ContainerDied","Data":"3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944"}
Jul 28 01:16:20.083223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.083215    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rbh22" event={"ID":"0094af81-4445-4668-b722-6654191eb3ca","Type":"ContainerDied","Data":"32e967c1bd91172318a8a385689af9d75a83e4d17ad71a42bbba83cfa701e09c"}
Jul 28 01:16:20.090322 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.090305    2552 scope.go:117] "RemoveContainer" containerID="4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418"
Jul 28 01:16:20.090561 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:16:20.090543    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418\": container with ID starting with 4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418 not found: ID does not exist" containerID="4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418"
Jul 28 01:16:20.090637 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.090574    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418"} err="failed to get container status \"4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418\": rpc error: code = NotFound desc = could not find container \"4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418\": container with ID starting with 4775a6ae611439a1bb30a757609214115759d5c593b3df480b0fd4c4bb693418 not found: ID does not exist"
Jul 28 01:16:20.090637 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.090596    2552 scope.go:117] "RemoveContainer" containerID="3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944"
Jul 28 01:16:20.099813 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.099775    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9zctw"]
Jul 28 01:16:20.099813 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.099800    2552 scope.go:117] "RemoveContainer" containerID="3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944"
Jul 28 01:16:20.100073 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:16:20.100054    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944\": container with ID starting with 3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944 not found: ID does not exist" containerID="3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944"
Jul 28 01:16:20.100177 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.100082    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944"} err="failed to get container status \"3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944\": rpc error: code = NotFound desc = could not find container \"3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944\": container with ID starting with 3778ef6ffbdff639e0bf77300f5beedc225f344bb8b5635115f1a9ef761a3944 not found: ID does not exist"
Jul 28 01:16:20.101952 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.101935    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9zctw"]
Jul 28 01:16:20.111617 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.111598    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbh22"]
Jul 28 01:16:20.115192 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:20.115173    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rbh22"]
Jul 28 01:16:22.021863 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:22.021829    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0094af81-4445-4668-b722-6654191eb3ca" path="/var/lib/kubelet/pods/0094af81-4445-4668-b722-6654191eb3ca/volumes"
Jul 28 01:16:22.022343 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:22.022225    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e76fce-9d0d-4739-8e2f-c9ff10d17333" path="/var/lib/kubelet/pods/05e76fce-9d0d-4739-8e2f-c9ff10d17333/volumes"
Jul 28 01:16:23.582603 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.582563    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:23.681461 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.681431    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:23.749520 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.749469    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:23.753707 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.753680    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58449fbb64-4knqr"]
Jul 28 01:16:23.754096 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.754078    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0094af81-4445-4668-b722-6654191eb3ca" containerName="authorino"
Jul 28 01:16:23.754219 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.754098    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0094af81-4445-4668-b722-6654191eb3ca" containerName="authorino"
Jul 28 01:16:23.754219 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.754163    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e76fce-9d0d-4739-8e2f-c9ff10d17333" containerName="authorino"
Jul 28 01:16:23.754219 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.754173    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e76fce-9d0d-4739-8e2f-c9ff10d17333" containerName="authorino"
Jul 28 01:16:23.754377 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.754289    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0094af81-4445-4668-b722-6654191eb3ca" containerName="authorino"
Jul 28 01:16:23.754377 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.754305    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e76fce-9d0d-4739-8e2f-c9ff10d17333" containerName="authorino"
Jul 28 01:16:23.812186 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.812153    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:23.817279 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.817257    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58449fbb64-4knqr"]
Jul 28 01:16:23.817398 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.817360    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:16:23.820528 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.820512    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-22sxl\""
Jul 28 01:16:23.820528 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.820521    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 01:16:23.820740 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.820514    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 01:16:23.924480 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.924449    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/367199cf-3774-4808-8f72-06f1f05f57c1-webhook-cert\") pod \"maas-controller-58449fbb64-4knqr\" (UID: \"367199cf-3774-4808-8f72-06f1f05f57c1\") " pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:16:23.924480 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:23.924479    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kk7r\" (UniqueName: \"kubernetes.io/projected/367199cf-3774-4808-8f72-06f1f05f57c1-kube-api-access-8kk7r\") pod \"maas-controller-58449fbb64-4knqr\" (UID: \"367199cf-3774-4808-8f72-06f1f05f57c1\") " pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:16:24.025202 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:24.025174    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/367199cf-3774-4808-8f72-06f1f05f57c1-webhook-cert\") pod \"maas-controller-58449fbb64-4knqr\" (UID: \"367199cf-3774-4808-8f72-06f1f05f57c1\") " pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:16:24.025202 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:24.025207    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kk7r\" (UniqueName: \"kubernetes.io/projected/367199cf-3774-4808-8f72-06f1f05f57c1-kube-api-access-8kk7r\") pod \"maas-controller-58449fbb64-4knqr\" (UID: \"367199cf-3774-4808-8f72-06f1f05f57c1\") " pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:16:24.027724 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:24.027700    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/367199cf-3774-4808-8f72-06f1f05f57c1-webhook-cert\") pod \"maas-controller-58449fbb64-4knqr\" (UID: \"367199cf-3774-4808-8f72-06f1f05f57c1\") " pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:16:24.032668 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:24.032651    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kk7r\" (UniqueName: \"kubernetes.io/projected/367199cf-3774-4808-8f72-06f1f05f57c1-kube-api-access-8kk7r\") pod \"maas-controller-58449fbb64-4knqr\" (UID: \"367199cf-3774-4808-8f72-06f1f05f57c1\") " pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:16:24.127349 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:24.127310    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:16:24.279884 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:24.279854    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58449fbb64-4knqr"]
Jul 28 01:16:24.281699 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:16:24.281667    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod367199cf_3774_4808_8f72_06f1f05f57c1.slice/crio-1951850fed145d2df816ffa03cd7da1c7c4d750728b34d37037a068b8cd46c74 WatchSource:0}: Error finding container 1951850fed145d2df816ffa03cd7da1c7c4d750728b34d37037a068b8cd46c74: Status 404 returned error can't find the container with id 1951850fed145d2df816ffa03cd7da1c7c4d750728b34d37037a068b8cd46c74
Jul 28 01:16:25.114744 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:25.114708    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58449fbb64-4knqr" event={"ID":"367199cf-3774-4808-8f72-06f1f05f57c1","Type":"ContainerStarted","Data":"1951850fed145d2df816ffa03cd7da1c7c4d750728b34d37037a068b8cd46c74"}
Jul 28 01:16:26.753762 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:26.753728    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:26.846657 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:26.846551    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:27.128386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:27.128289    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58449fbb64-4knqr" event={"ID":"367199cf-3774-4808-8f72-06f1f05f57c1","Type":"ContainerStarted","Data":"af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e"}
Jul 28 01:16:27.128386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:27.128358    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:16:27.149508 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:27.149456    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58449fbb64-4knqr" podStartSLOduration=1.840399173 podStartE2EDuration="4.149435948s" totalImagesPullingTime="2.309036775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:16:27.147879699 +0000 UTC m=+719.762187771" watchObservedRunningTime="2026-07-28 01:16:27.149435948 +0000 UTC m=+719.763744031"
Jul 28 01:16:38.135896 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:38.135863    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:16:59.397509 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:59.397455    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:59.490500 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:59.490465    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:16:59.961466 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:16:59.961430    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:00.414097 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.414064    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:00.519507 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.519473    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:00.622884 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.622857    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:00.636403 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.636370    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"]
Jul 28 01:17:00.641719 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.641698    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"
Jul 28 01:17:00.643955 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.643935    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 28 01:17:00.644080 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.643952    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4hwpg\""
Jul 28 01:17:00.655245 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.654706    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"]
Jul 28 01:17:00.657909 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.657886    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-ps9zc"]
Jul 28 01:17:00.661167 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.661149    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc"
Jul 28 01:17:00.671063 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.671039    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-ps9zc"]
Jul 28 01:17:00.741257 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.741216    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e1355a-db6d-41a2-bb00-e6963d587e74-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-ps9zc\" (UID: \"48e1355a-db6d-41a2-bb00-e6963d587e74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc"
Jul 28 01:17:00.741440 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.741269    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7scpm\" (UniqueName: \"kubernetes.io/projected/1b0b503d-4082-4ad2-a360-ec9f6c090f04-kube-api-access-7scpm\") pod \"payload-pre-processing-687dbb6cf6-qvcbl\" (UID: \"1b0b503d-4082-4ad2-a360-ec9f6c090f04\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"
Jul 28 01:17:00.741440 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.741328    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2pkr\" (UniqueName: \"kubernetes.io/projected/48e1355a-db6d-41a2-bb00-e6963d587e74-kube-api-access-x2pkr\") pod \"payload-processing-5cc6cd444b-ps9zc\" (UID: \"48e1355a-db6d-41a2-bb00-e6963d587e74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc"
Jul 28 01:17:00.741440 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.741397    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0b503d-4082-4ad2-a360-ec9f6c090f04-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-qvcbl\" (UID: \"1b0b503d-4082-4ad2-a360-ec9f6c090f04\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"
Jul 28 01:17:00.842667 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.842633    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0b503d-4082-4ad2-a360-ec9f6c090f04-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-qvcbl\" (UID: \"1b0b503d-4082-4ad2-a360-ec9f6c090f04\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"
Jul 28 01:17:00.842857 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.842706    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e1355a-db6d-41a2-bb00-e6963d587e74-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-ps9zc\" (UID: \"48e1355a-db6d-41a2-bb00-e6963d587e74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc"
Jul 28 01:17:00.842857 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.842735    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7scpm\" (UniqueName: \"kubernetes.io/projected/1b0b503d-4082-4ad2-a360-ec9f6c090f04-kube-api-access-7scpm\") pod \"payload-pre-processing-687dbb6cf6-qvcbl\" (UID: \"1b0b503d-4082-4ad2-a360-ec9f6c090f04\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"
Jul 28 01:17:00.842857 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.842757    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2pkr\" (UniqueName: \"kubernetes.io/projected/48e1355a-db6d-41a2-bb00-e6963d587e74-kube-api-access-x2pkr\") pod \"payload-processing-5cc6cd444b-ps9zc\" (UID: \"48e1355a-db6d-41a2-bb00-e6963d587e74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc"
Jul 28 01:17:00.843513 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.843488    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48e1355a-db6d-41a2-bb00-e6963d587e74-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-ps9zc\" (UID: \"48e1355a-db6d-41a2-bb00-e6963d587e74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc"
Jul 28 01:17:00.843626 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.843543    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b0b503d-4082-4ad2-a360-ec9f6c090f04-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-qvcbl\" (UID: \"1b0b503d-4082-4ad2-a360-ec9f6c090f04\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"
Jul 28 01:17:00.850507 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.850486    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7scpm\" (UniqueName: \"kubernetes.io/projected/1b0b503d-4082-4ad2-a360-ec9f6c090f04-kube-api-access-7scpm\") pod \"payload-pre-processing-687dbb6cf6-qvcbl\" (UID: \"1b0b503d-4082-4ad2-a360-ec9f6c090f04\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"
Jul 28 01:17:00.850635 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.850613    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2pkr\" (UniqueName: \"kubernetes.io/projected/48e1355a-db6d-41a2-bb00-e6963d587e74-kube-api-access-x2pkr\") pod \"payload-processing-5cc6cd444b-ps9zc\" (UID: \"48e1355a-db6d-41a2-bb00-e6963d587e74\") " pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc"
Jul 28 01:17:00.960276 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.960191    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"
Jul 28 01:17:00.973228 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:00.973202    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc"
Jul 28 01:17:01.109418 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:01.109386    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"]
Jul 28 01:17:01.112437 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:17:01.112405    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0b503d_4082_4ad2_a360_ec9f6c090f04.slice/crio-18da8732df153da61ec94f2eb530ed524eec81c312de3ebfadf49de1d455cfd8 WatchSource:0}: Error finding container 18da8732df153da61ec94f2eb530ed524eec81c312de3ebfadf49de1d455cfd8: Status 404 returned error can't find the container with id 18da8732df153da61ec94f2eb530ed524eec81c312de3ebfadf49de1d455cfd8
Jul 28 01:17:01.134394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:01.134367    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-ps9zc"]
Jul 28 01:17:01.135835 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:17:01.135808    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e1355a_db6d_41a2_bb00_e6963d587e74.slice/crio-fcf7c18fe89bb1707b3e06048cadb1d52f638890c48be100551b70e40372b985 WatchSource:0}: Error finding container fcf7c18fe89bb1707b3e06048cadb1d52f638890c48be100551b70e40372b985: Status 404 returned error can't find the container with id fcf7c18fe89bb1707b3e06048cadb1d52f638890c48be100551b70e40372b985
Jul 28 01:17:01.313637 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:01.313544    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc" event={"ID":"48e1355a-db6d-41a2-bb00-e6963d587e74","Type":"ContainerStarted","Data":"fcf7c18fe89bb1707b3e06048cadb1d52f638890c48be100551b70e40372b985"}
Jul 28 01:17:01.314747 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:01.314724    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl" event={"ID":"1b0b503d-4082-4ad2-a360-ec9f6c090f04","Type":"ContainerStarted","Data":"18da8732df153da61ec94f2eb530ed524eec81c312de3ebfadf49de1d455cfd8"}
Jul 28 01:17:04.341088 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:04.341048    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc" event={"ID":"48e1355a-db6d-41a2-bb00-e6963d587e74","Type":"ContainerStarted","Data":"eb9642ae267137b81d2926cdc7088db0ed11a9e5d524465e40f44c45c70a67bb"}
Jul 28 01:17:04.341577 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:04.341171    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc"
Jul 28 01:17:04.342715 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:04.342691    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl" event={"ID":"1b0b503d-4082-4ad2-a360-ec9f6c090f04","Type":"ContainerStarted","Data":"1136a8825047588c3d2303b5f7f9f7c80d2f447e3ee033a6ccb651c22bdee378"}
Jul 28 01:17:04.342835 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:04.342760    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"
Jul 28 01:17:04.359544 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:04.359501    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc" podStartSLOduration=2.193116519 podStartE2EDuration="4.359487072s" totalImagesPullingTime="2.166370553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:04.356166946 +0000 UTC m=+756.970475019" watchObservedRunningTime="2026-07-28 01:17:04.359487072 +0000 UTC m=+756.973795144"
Jul 28 01:17:04.370552 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:04.370494    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl" podStartSLOduration=2.187425682 podStartE2EDuration="4.370476741s" totalImagesPullingTime="2.183051059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:04.369995418 +0000 UTC m=+756.984303490" watchObservedRunningTime="2026-07-28 01:17:04.370476741 +0000 UTC m=+756.984784813"
Jul 28 01:17:09.376454 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:09.376420    2552 generic.go:356] "Generic (PLEG): container finished" podID="8328a25c-7f2b-48bd-a2aa-77de4de41a1d" containerID="428ccbea25f2151ccb2c9dcbf09863a95acb7c552364772397ebd8b9da6daaa7" exitCode=0
Jul 28 01:17:09.376946 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:09.376488    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd" event={"ID":"8328a25c-7f2b-48bd-a2aa-77de4de41a1d","Type":"ContainerDied","Data":"428ccbea25f2151ccb2c9dcbf09863a95acb7c552364772397ebd8b9da6daaa7"}
Jul 28 01:17:09.376946 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:09.376875    2552 scope.go:117] "RemoveContainer" containerID="428ccbea25f2151ccb2c9dcbf09863a95acb7c552364772397ebd8b9da6daaa7"
Jul 28 01:17:09.377930 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:09.377887    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:17:09.378048 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:09.377978    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:17:09.378048 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:09.378027    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:17:10.388287 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:10.388254    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd" event={"ID":"8328a25c-7f2b-48bd-a2aa-77de4de41a1d","Type":"ContainerStarted","Data":"38d7f8d67d7e12698951ad78d031904674ced1da8a2a630a0a8ff449b218488d"}
Jul 28 01:17:10.516327 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:10.516292    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:10.609671 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:10.609632    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:10.661078 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:10.660973    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:17:10.662277 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:10.662243    2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zp4fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 28 01:17:10.662407 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:10.662332    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd" podUID="8328a25c-7f2b-48bd-a2aa-77de4de41a1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 28 01:17:11.661035 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:11.660990    2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zp4fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 28 01:17:11.661568 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:11.661063    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd" podUID="8328a25c-7f2b-48bd-a2aa-77de4de41a1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 28 01:17:12.662065 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:12.662020    2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zp4fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 28 01:17:12.662604 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:12.662119    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd" podUID="8328a25c-7f2b-48bd-a2aa-77de4de41a1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 28 01:17:13.661592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:13.661551    2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-zp4fd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 28 01:17:13.661911 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:13.661884    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd" podUID="8328a25c-7f2b-48bd-a2aa-77de4de41a1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 28 01:17:13.826706 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:13.826671    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:17:14.667346 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:14.667310    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:17:14.668672 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:14.668654    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-zp4fd"
Jul 28 01:17:15.350565 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:15.350526    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl" podUID="1b0b503d-4082-4ad2-a360-ec9f6c090f04" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.47:9004: connect: connection refused"
Jul 28 01:17:15.350994 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:15.350879    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-ps9zc"
Jul 28 01:17:25.349520 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:25.349485    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-qvcbl"
Jul 28 01:17:29.214357 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.214323    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"]
Jul 28 01:17:29.217345 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.217326    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.219841 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.219818    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 01:17:29.219984 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.219892    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bb82g\""
Jul 28 01:17:29.220825 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.220805    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 01:17:29.220967 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.220883    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 28 01:17:29.234367 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.234338    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"]
Jul 28 01:17:29.258379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.258346    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:29.331370 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.331284    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.331740 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.331696    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77089b11-2755-494c-a1a9-6d6dd8ad4471-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.331864 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.331805    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.331919 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.331893    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpgvb\" (UniqueName: \"kubernetes.io/projected/77089b11-2755-494c-a1a9-6d6dd8ad4471-kube-api-access-gpgvb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.331983 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.331967    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.332039 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.332000    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.433214 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.433177    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77089b11-2755-494c-a1a9-6d6dd8ad4471-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.433413 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.433224    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.433413 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.433286    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpgvb\" (UniqueName: \"kubernetes.io/projected/77089b11-2755-494c-a1a9-6d6dd8ad4471-kube-api-access-gpgvb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.433413 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.433321    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.433413 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.433342    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.433413 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.433389    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.433761 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.433742    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.433823 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.433740    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.433823 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.433789    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.435647 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.435624    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77089b11-2755-494c-a1a9-6d6dd8ad4471-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.435882 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.435866    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77089b11-2755-494c-a1a9-6d6dd8ad4471-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.441632 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.441611    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpgvb\" (UniqueName: \"kubernetes.io/projected/77089b11-2755-494c-a1a9-6d6dd8ad4471-kube-api-access-gpgvb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf\" (UID: \"77089b11-2755-494c-a1a9-6d6dd8ad4471\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.528717 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.528625    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:29.681268 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:29.681241    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"]
Jul 28 01:17:29.684831 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:17:29.684082    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77089b11_2755_494c_a1a9_6d6dd8ad4471.slice/crio-d2c6d723c669d3e54a146ed380e0e63c58b1051765f61b428d29651983e0fe1e WatchSource:0}: Error finding container d2c6d723c669d3e54a146ed380e0e63c58b1051765f61b428d29651983e0fe1e: Status 404 returned error can't find the container with id d2c6d723c669d3e54a146ed380e0e63c58b1051765f61b428d29651983e0fe1e
Jul 28 01:17:30.501512 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:30.501477    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf" event={"ID":"77089b11-2755-494c-a1a9-6d6dd8ad4471","Type":"ContainerStarted","Data":"d2c6d723c669d3e54a146ed380e0e63c58b1051765f61b428d29651983e0fe1e"}
Jul 28 01:17:31.509050 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:31.509010    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf" event={"ID":"77089b11-2755-494c-a1a9-6d6dd8ad4471","Type":"ContainerStarted","Data":"ccc0b34ed86eaac850c24297bc735a62958903af97bcddfef974b0bc535aa9b2"}
Jul 28 01:17:31.530304 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:31.530249    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf" podStartSLOduration=1.33979339 podStartE2EDuration="2.530231396s" totalImagesPullingTime="1.190438006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:31.527373415 +0000 UTC m=+784.141681488" watchObservedRunningTime="2026-07-28 01:17:31.530231396 +0000 UTC m=+784.144539467"
Jul 28 01:17:37.364162 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:37.364100    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:39.529768 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:39.529722    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:39.530235 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:39.529819    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:39.542597 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:39.542572    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:39.567056 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:39.567028    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf"
Jul 28 01:17:47.517338 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.517301    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"]
Jul 28 01:17:47.521271 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.521248    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.523691 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.523671    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 28 01:17:47.532333 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.532309    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"]
Jul 28 01:17:47.553510 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.553475    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:47.593981 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.593896    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.593981 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.593951    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.594264 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.594047    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grsh2\" (UniqueName: \"kubernetes.io/projected/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-kube-api-access-grsh2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.594264 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.594078    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.594264 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.594153    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.594264 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.594176    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.695556 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.695513    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grsh2\" (UniqueName: \"kubernetes.io/projected/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-kube-api-access-grsh2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.695556 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.695557    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.695786 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.695596    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.695786 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.695614    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.695786 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.695652    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.695786 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.695699    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.696094 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.696073    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.696169 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.696080    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.696217 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.696166    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.698974 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.698949    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.699107 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.699087    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.707111 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.707085    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grsh2\" (UniqueName: \"kubernetes.io/projected/3ca98f87-98ca-4c1e-b769-5f7b7eb2f053-kube-api-access-grsh2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qqt8s\" (UID: \"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.832323 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.832230    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:47.937179 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.937122    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:47.980748 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:47.980723    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"]
Jul 28 01:17:47.982380 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:17:47.982352    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca98f87_98ca_4c1e_b769_5f7b7eb2f053.slice/crio-a850a1f6b04913d7a64f710742bc1da4e42e2d66a50dd356e2fc67d14711b246 WatchSource:0}: Error finding container a850a1f6b04913d7a64f710742bc1da4e42e2d66a50dd356e2fc67d14711b246: Status 404 returned error can't find the container with id a850a1f6b04913d7a64f710742bc1da4e42e2d66a50dd356e2fc67d14711b246
Jul 28 01:17:48.603628 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:48.603521    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s" event={"ID":"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053","Type":"ContainerStarted","Data":"27ef646956682744ef616a320f1f707f0005561f9ff4c7d16cd5de05f112d3ca"}
Jul 28 01:17:48.603628 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:48.603589    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s" event={"ID":"3ca98f87-98ca-4c1e-b769-5f7b7eb2f053","Type":"ContainerStarted","Data":"a850a1f6b04913d7a64f710742bc1da4e42e2d66a50dd356e2fc67d14711b246"}
Jul 28 01:17:48.620811 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:48.620751    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s" podStartSLOduration=1.423913812 podStartE2EDuration="1.620729803s" totalImagesPullingTime="196.815991ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:17:48.620471243 +0000 UTC m=+801.234779317" watchObservedRunningTime="2026-07-28 01:17:48.620729803 +0000 UTC m=+801.235037875"
Jul 28 01:17:56.730956 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:56.730915    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:17:57.832761 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:57.832715    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:57.833210 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:57.832799    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:57.845633 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:57.845604    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:17:58.670702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:17:58.670671    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qqt8s"
Jul 28 01:18:08.552755 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:08.549908    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:12.336193 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:12.336162    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:21.921836 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:21.921798    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:22.022995 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:22.022960    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:25.202860 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:25.202831    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:58.514261 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.514224    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56cc9f6f8f-zt94p"]
Jul 28 01:18:58.517815 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.517798    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cc9f6f8f-zt94p"
Jul 28 01:18:58.527735 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.527708    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56cc9f6f8f-zt94p"]
Jul 28 01:18:58.639673 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.639638    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp8ln\" (UniqueName: \"kubernetes.io/projected/66bc17ec-ac0d-42ea-bc69-61bcf93c09bd-kube-api-access-vp8ln\") pod \"authorino-56cc9f6f8f-zt94p\" (UID: \"66bc17ec-ac0d-42ea-bc69-61bcf93c09bd\") " pod="kuadrant-system/authorino-56cc9f6f8f-zt94p"
Jul 28 01:18:58.639842 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.639688    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66bc17ec-ac0d-42ea-bc69-61bcf93c09bd-tls-cert\") pod \"authorino-56cc9f6f8f-zt94p\" (UID: \"66bc17ec-ac0d-42ea-bc69-61bcf93c09bd\") " pod="kuadrant-system/authorino-56cc9f6f8f-zt94p"
Jul 28 01:18:58.741192 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.741152    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp8ln\" (UniqueName: \"kubernetes.io/projected/66bc17ec-ac0d-42ea-bc69-61bcf93c09bd-kube-api-access-vp8ln\") pod \"authorino-56cc9f6f8f-zt94p\" (UID: \"66bc17ec-ac0d-42ea-bc69-61bcf93c09bd\") " pod="kuadrant-system/authorino-56cc9f6f8f-zt94p"
Jul 28 01:18:58.741476 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.741218    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66bc17ec-ac0d-42ea-bc69-61bcf93c09bd-tls-cert\") pod \"authorino-56cc9f6f8f-zt94p\" (UID: \"66bc17ec-ac0d-42ea-bc69-61bcf93c09bd\") " pod="kuadrant-system/authorino-56cc9f6f8f-zt94p"
Jul 28 01:18:58.744027 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.744004    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66bc17ec-ac0d-42ea-bc69-61bcf93c09bd-tls-cert\") pod \"authorino-56cc9f6f8f-zt94p\" (UID: \"66bc17ec-ac0d-42ea-bc69-61bcf93c09bd\") " pod="kuadrant-system/authorino-56cc9f6f8f-zt94p"
Jul 28 01:18:58.766150 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.766062    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp8ln\" (UniqueName: \"kubernetes.io/projected/66bc17ec-ac0d-42ea-bc69-61bcf93c09bd-kube-api-access-vp8ln\") pod \"authorino-56cc9f6f8f-zt94p\" (UID: \"66bc17ec-ac0d-42ea-bc69-61bcf93c09bd\") " pod="kuadrant-system/authorino-56cc9f6f8f-zt94p"
Jul 28 01:18:58.794744 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.794717    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:18:58.827668 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.827641    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cc9f6f8f-zt94p"
Jul 28 01:18:58.976608 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:18:58.976558    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66bc17ec_ac0d_42ea_bc69_61bcf93c09bd.slice/crio-08f0d161caddbea744af374797da6f0d721d2d17ce4060c098cb5618a52f4026 WatchSource:0}: Error finding container 08f0d161caddbea744af374797da6f0d721d2d17ce4060c098cb5618a52f4026: Status 404 returned error can't find the container with id 08f0d161caddbea744af374797da6f0d721d2d17ce4060c098cb5618a52f4026
Jul 28 01:18:58.980027 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:58.980002    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56cc9f6f8f-zt94p"]
Jul 28 01:18:59.001118 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:18:59.001093    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cc9f6f8f-zt94p" event={"ID":"66bc17ec-ac0d-42ea-bc69-61bcf93c09bd","Type":"ContainerStarted","Data":"08f0d161caddbea744af374797da6f0d721d2d17ce4060c098cb5618a52f4026"}
Jul 28 01:19:00.015067 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.015029    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cc9f6f8f-zt94p" event={"ID":"66bc17ec-ac0d-42ea-bc69-61bcf93c09bd","Type":"ContainerStarted","Data":"a63ba8105fdd4bb9bb0a9769db63674d0c1267ca30c654a31a2168452136cd18"}
Jul 28 01:19:00.153411 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.153329    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56cc9f6f8f-zt94p" podStartSLOduration=1.6527112609999999 podStartE2EDuration="2.153302669s" totalImagesPullingTime="500.591408ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:19:00.079514945 +0000 UTC m=+872.693823017" watchObservedRunningTime="2026-07-28 01:19:00.153302669 +0000 UTC m=+872.767610742"
Jul 28 01:19:00.155731 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.155703    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-795864b7f6-4sqn7"]
Jul 28 01:19:00.155946 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.155914    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-795864b7f6-4sqn7" podUID="4fd59d28-9245-45fa-8f0f-9787836efbc5" containerName="authorino" containerID="cri-o://a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f" gracePeriod=30
Jul 28 01:19:00.416362 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.416332    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795864b7f6-4sqn7"
Jul 28 01:19:00.559347 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.559260    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl7fq\" (UniqueName: \"kubernetes.io/projected/4fd59d28-9245-45fa-8f0f-9787836efbc5-kube-api-access-bl7fq\") pod \"4fd59d28-9245-45fa-8f0f-9787836efbc5\" (UID: \"4fd59d28-9245-45fa-8f0f-9787836efbc5\") "
Jul 28 01:19:00.559347 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.559306    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fd59d28-9245-45fa-8f0f-9787836efbc5-tls-cert\") pod \"4fd59d28-9245-45fa-8f0f-9787836efbc5\" (UID: \"4fd59d28-9245-45fa-8f0f-9787836efbc5\") "
Jul 28 01:19:00.561813 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.561771    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fd59d28-9245-45fa-8f0f-9787836efbc5-kube-api-access-bl7fq" (OuterVolumeSpecName: "kube-api-access-bl7fq") pod "4fd59d28-9245-45fa-8f0f-9787836efbc5" (UID: "4fd59d28-9245-45fa-8f0f-9787836efbc5"). InnerVolumeSpecName "kube-api-access-bl7fq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:19:00.572030 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.571993    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd59d28-9245-45fa-8f0f-9787836efbc5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4fd59d28-9245-45fa-8f0f-9787836efbc5" (UID: "4fd59d28-9245-45fa-8f0f-9787836efbc5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:19:00.573409 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.573387    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:19:00.660902 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.660869    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl7fq\" (UniqueName: \"kubernetes.io/projected/4fd59d28-9245-45fa-8f0f-9787836efbc5-kube-api-access-bl7fq\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:19:00.660902 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:00.660901    2552 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4fd59d28-9245-45fa-8f0f-9787836efbc5-tls-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:19:01.023643 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:01.023602    2552 generic.go:356] "Generic (PLEG): container finished" podID="4fd59d28-9245-45fa-8f0f-9787836efbc5" containerID="a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f" exitCode=0
Jul 28 01:19:01.024114 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:01.023653    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795864b7f6-4sqn7"
Jul 28 01:19:01.024114 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:01.023679    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795864b7f6-4sqn7" event={"ID":"4fd59d28-9245-45fa-8f0f-9787836efbc5","Type":"ContainerDied","Data":"a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f"}
Jul 28 01:19:01.024114 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:01.023723    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795864b7f6-4sqn7" event={"ID":"4fd59d28-9245-45fa-8f0f-9787836efbc5","Type":"ContainerDied","Data":"c87e450f3060b539ad468cf93837774d3ff9ac527217dadbafe1c33c7179b82f"}
Jul 28 01:19:01.024114 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:01.023740    2552 scope.go:117] "RemoveContainer" containerID="a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f"
Jul 28 01:19:01.034492 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:01.034469    2552 scope.go:117] "RemoveContainer" containerID="a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f"
Jul 28 01:19:01.035015 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:19:01.034992    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f\": container with ID starting with a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f not found: ID does not exist" containerID="a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f"
Jul 28 01:19:01.035104 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:01.035022    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f"} err="failed to get container status \"a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f\": rpc error: code = NotFound desc = could not find container \"a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f\": container with ID starting with a0b624064a8792190a724a33f9a6533057bbbfde3f8af960c61ff1e92e2f8c6f not found: ID does not exist"
Jul 28 01:19:01.081824 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:01.081779    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-795864b7f6-4sqn7"]
Jul 28 01:19:01.098223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:01.098184    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-795864b7f6-4sqn7"]
Jul 28 01:19:02.023883 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:02.023846    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fd59d28-9245-45fa-8f0f-9787836efbc5" path="/var/lib/kubelet/pods/4fd59d28-9245-45fa-8f0f-9787836efbc5/volumes"
Jul 28 01:19:46.879951 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:46.879910    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58449fbb64-4knqr"]
Jul 28 01:19:46.880536 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:46.880189    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58449fbb64-4knqr" podUID="367199cf-3774-4808-8f72-06f1f05f57c1" containerName="manager" containerID="cri-o://af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e" gracePeriod=30
Jul 28 01:19:47.140693 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.140669    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:19:47.279734 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.279702    2552 generic.go:356] "Generic (PLEG): container finished" podID="367199cf-3774-4808-8f72-06f1f05f57c1" containerID="af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e" exitCode=0
Jul 28 01:19:47.279941 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.279757    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58449fbb64-4knqr"
Jul 28 01:19:47.279941 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.279781    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58449fbb64-4knqr" event={"ID":"367199cf-3774-4808-8f72-06f1f05f57c1","Type":"ContainerDied","Data":"af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e"}
Jul 28 01:19:47.279941 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.279823    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58449fbb64-4knqr" event={"ID":"367199cf-3774-4808-8f72-06f1f05f57c1","Type":"ContainerDied","Data":"1951850fed145d2df816ffa03cd7da1c7c4d750728b34d37037a068b8cd46c74"}
Jul 28 01:19:47.279941 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.279844    2552 scope.go:117] "RemoveContainer" containerID="af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e"
Jul 28 01:19:47.289509 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.289483    2552 scope.go:117] "RemoveContainer" containerID="af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e"
Jul 28 01:19:47.289785 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:19:47.289767    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e\": container with ID starting with af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e not found: ID does not exist" containerID="af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e"
Jul 28 01:19:47.289837 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.289797    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e"} err="failed to get container status \"af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e\": rpc error: code = NotFound desc = could not find container \"af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e\": container with ID starting with af47dcf46d736c0446c19c8b07dbf4dae8e3244fb8cd19dd446a1a97d821213e not found: ID does not exist"
Jul 28 01:19:47.302340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.302317    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/367199cf-3774-4808-8f72-06f1f05f57c1-webhook-cert\") pod \"367199cf-3774-4808-8f72-06f1f05f57c1\" (UID: \"367199cf-3774-4808-8f72-06f1f05f57c1\") "
Jul 28 01:19:47.302464 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.302419    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kk7r\" (UniqueName: \"kubernetes.io/projected/367199cf-3774-4808-8f72-06f1f05f57c1-kube-api-access-8kk7r\") pod \"367199cf-3774-4808-8f72-06f1f05f57c1\" (UID: \"367199cf-3774-4808-8f72-06f1f05f57c1\") "
Jul 28 01:19:47.304668 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.304643    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/367199cf-3774-4808-8f72-06f1f05f57c1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "367199cf-3774-4808-8f72-06f1f05f57c1" (UID: "367199cf-3774-4808-8f72-06f1f05f57c1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:19:47.304778 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.304704    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/367199cf-3774-4808-8f72-06f1f05f57c1-kube-api-access-8kk7r" (OuterVolumeSpecName: "kube-api-access-8kk7r") pod "367199cf-3774-4808-8f72-06f1f05f57c1" (UID: "367199cf-3774-4808-8f72-06f1f05f57c1"). InnerVolumeSpecName "kube-api-access-8kk7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:19:47.403370 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.403282    2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/367199cf-3774-4808-8f72-06f1f05f57c1-webhook-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:19:47.403370 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.403313    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kk7r\" (UniqueName: \"kubernetes.io/projected/367199cf-3774-4808-8f72-06f1f05f57c1-kube-api-access-8kk7r\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:19:47.609026 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.608989    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58449fbb64-4knqr"]
Jul 28 01:19:47.618279 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:47.618245    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58449fbb64-4knqr"]
Jul 28 01:19:48.022965 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:19:48.022927    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="367199cf-3774-4808-8f72-06f1f05f57c1" path="/var/lib/kubelet/pods/367199cf-3774-4808-8f72-06f1f05f57c1/volumes"
Jul 28 01:20:00.587883 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:00.587841    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:01.315656 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:01.315612    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:01.432057 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:01.432025    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:20:48.516546 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.516465    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58449fbb64-sxgmh"]
Jul 28 01:20:48.517003 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.516872    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd59d28-9245-45fa-8f0f-9787836efbc5" containerName="authorino"
Jul 28 01:20:48.517003 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.516883    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd59d28-9245-45fa-8f0f-9787836efbc5" containerName="authorino"
Jul 28 01:20:48.517003 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.516906    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367199cf-3774-4808-8f72-06f1f05f57c1" containerName="manager"
Jul 28 01:20:48.517003 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.516912    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="367199cf-3774-4808-8f72-06f1f05f57c1" containerName="manager"
Jul 28 01:20:48.517003 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.516976    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="367199cf-3774-4808-8f72-06f1f05f57c1" containerName="manager"
Jul 28 01:20:48.517003 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.516987    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd59d28-9245-45fa-8f0f-9787836efbc5" containerName="authorino"
Jul 28 01:20:48.521080 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.521061    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:20:48.530291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.530272    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 01:20:48.531235 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.531217    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 01:20:48.531332 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.531244    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-22sxl\""
Jul 28 01:20:48.541604 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.541580    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58449fbb64-sxgmh"]
Jul 28 01:20:48.571656 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.571627    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a206ef69-3a05-45d8-91d6-38600ba2da8e-webhook-cert\") pod \"maas-controller-58449fbb64-sxgmh\" (UID: \"a206ef69-3a05-45d8-91d6-38600ba2da8e\") " pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:20:48.571777 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.571672    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99qzt\" (UniqueName: \"kubernetes.io/projected/a206ef69-3a05-45d8-91d6-38600ba2da8e-kube-api-access-99qzt\") pod \"maas-controller-58449fbb64-sxgmh\" (UID: \"a206ef69-3a05-45d8-91d6-38600ba2da8e\") " pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:20:48.672376 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.672341    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a206ef69-3a05-45d8-91d6-38600ba2da8e-webhook-cert\") pod \"maas-controller-58449fbb64-sxgmh\" (UID: \"a206ef69-3a05-45d8-91d6-38600ba2da8e\") " pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:20:48.672376 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.672382    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99qzt\" (UniqueName: \"kubernetes.io/projected/a206ef69-3a05-45d8-91d6-38600ba2da8e-kube-api-access-99qzt\") pod \"maas-controller-58449fbb64-sxgmh\" (UID: \"a206ef69-3a05-45d8-91d6-38600ba2da8e\") " pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:20:48.675026 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.674995    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a206ef69-3a05-45d8-91d6-38600ba2da8e-webhook-cert\") pod \"maas-controller-58449fbb64-sxgmh\" (UID: \"a206ef69-3a05-45d8-91d6-38600ba2da8e\") " pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:20:48.683924 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.683899    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99qzt\" (UniqueName: \"kubernetes.io/projected/a206ef69-3a05-45d8-91d6-38600ba2da8e-kube-api-access-99qzt\") pod \"maas-controller-58449fbb64-sxgmh\" (UID: \"a206ef69-3a05-45d8-91d6-38600ba2da8e\") " pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:20:48.830599 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.830509    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:20:48.970530 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:48.970502    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58449fbb64-sxgmh"]
Jul 28 01:20:48.970832 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:20:48.970808    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda206ef69_3a05_45d8_91d6_38600ba2da8e.slice/crio-0fc2c82fb74831a0a69c5ea074e627f1cdcc07a7f689779eea1e56ab6a2b17ef WatchSource:0}: Error finding container 0fc2c82fb74831a0a69c5ea074e627f1cdcc07a7f689779eea1e56ab6a2b17ef: Status 404 returned error can't find the container with id 0fc2c82fb74831a0a69c5ea074e627f1cdcc07a7f689779eea1e56ab6a2b17ef
Jul 28 01:20:49.635856 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:49.635816    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58449fbb64-sxgmh" event={"ID":"a206ef69-3a05-45d8-91d6-38600ba2da8e","Type":"ContainerStarted","Data":"2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386"}
Jul 28 01:20:49.636281 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:49.635870    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58449fbb64-sxgmh" event={"ID":"a206ef69-3a05-45d8-91d6-38600ba2da8e","Type":"ContainerStarted","Data":"0fc2c82fb74831a0a69c5ea074e627f1cdcc07a7f689779eea1e56ab6a2b17ef"}
Jul 28 01:20:49.636281 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:49.635892    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:20:49.659679 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:20:49.659632    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58449fbb64-sxgmh" podStartSLOduration=1.21333039 podStartE2EDuration="1.659615962s" totalImagesPullingTime="446.285572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:20:49.657405547 +0000 UTC m=+982.271713615" watchObservedRunningTime="2026-07-28 01:20:49.659615962 +0000 UTC m=+982.273924038"
Jul 28 01:21:00.643319 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:00.643281    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:21:05.176140 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.176103    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:05.279494 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.279447    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58449fbb64-sxgmh"]
Jul 28 01:21:05.279921 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.279848    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58449fbb64-sxgmh" podUID="a206ef69-3a05-45d8-91d6-38600ba2da8e" containerName="manager" containerID="cri-o://2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386" gracePeriod=30
Jul 28 01:21:05.535030 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.534999    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:21:05.643606 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.643565    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99qzt\" (UniqueName: \"kubernetes.io/projected/a206ef69-3a05-45d8-91d6-38600ba2da8e-kube-api-access-99qzt\") pod \"a206ef69-3a05-45d8-91d6-38600ba2da8e\" (UID: \"a206ef69-3a05-45d8-91d6-38600ba2da8e\") "
Jul 28 01:21:05.643823 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.643649    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a206ef69-3a05-45d8-91d6-38600ba2da8e-webhook-cert\") pod \"a206ef69-3a05-45d8-91d6-38600ba2da8e\" (UID: \"a206ef69-3a05-45d8-91d6-38600ba2da8e\") "
Jul 28 01:21:05.646016 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.645979    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a206ef69-3a05-45d8-91d6-38600ba2da8e-kube-api-access-99qzt" (OuterVolumeSpecName: "kube-api-access-99qzt") pod "a206ef69-3a05-45d8-91d6-38600ba2da8e" (UID: "a206ef69-3a05-45d8-91d6-38600ba2da8e"). InnerVolumeSpecName "kube-api-access-99qzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:21:05.646016 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.645993    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a206ef69-3a05-45d8-91d6-38600ba2da8e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a206ef69-3a05-45d8-91d6-38600ba2da8e" (UID: "a206ef69-3a05-45d8-91d6-38600ba2da8e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 01:21:05.723479 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.723383    2552 generic.go:356] "Generic (PLEG): container finished" podID="a206ef69-3a05-45d8-91d6-38600ba2da8e" containerID="2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386" exitCode=0
Jul 28 01:21:05.723479 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.723430    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58449fbb64-sxgmh"
Jul 28 01:21:05.723681 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.723473    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58449fbb64-sxgmh" event={"ID":"a206ef69-3a05-45d8-91d6-38600ba2da8e","Type":"ContainerDied","Data":"2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386"}
Jul 28 01:21:05.723681 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.723523    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58449fbb64-sxgmh" event={"ID":"a206ef69-3a05-45d8-91d6-38600ba2da8e","Type":"ContainerDied","Data":"0fc2c82fb74831a0a69c5ea074e627f1cdcc07a7f689779eea1e56ab6a2b17ef"}
Jul 28 01:21:05.723681 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.723548    2552 scope.go:117] "RemoveContainer" containerID="2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386"
Jul 28 01:21:05.733199 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.733153    2552 scope.go:117] "RemoveContainer" containerID="2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386"
Jul 28 01:21:05.733522 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:21:05.733502    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386\": container with ID starting with 2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386 not found: ID does not exist" containerID="2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386"
Jul 28 01:21:05.733586 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.733532    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386"} err="failed to get container status \"2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386\": rpc error: code = NotFound desc = could not find container \"2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386\": container with ID starting with 2a79c346893e121ccb4e1beb3d210b7baad99bfd6c86cf0463942bc7a902c386 not found: ID does not exist"
Jul 28 01:21:05.744452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.744421    2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a206ef69-3a05-45d8-91d6-38600ba2da8e-webhook-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:21:05.744452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.744447    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99qzt\" (UniqueName: \"kubernetes.io/projected/a206ef69-3a05-45d8-91d6-38600ba2da8e-kube-api-access-99qzt\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:21:05.748652 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.748623    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58449fbb64-sxgmh"]
Jul 28 01:21:05.752796 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:05.752767    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58449fbb64-sxgmh"]
Jul 28 01:21:06.023369 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.023289    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a206ef69-3a05-45d8-91d6-38600ba2da8e" path="/var/lib/kubelet/pods/a206ef69-3a05-45d8-91d6-38600ba2da8e/volumes"
Jul 28 01:21:06.392357 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.392303    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:06.516376 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.516339    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58449fbb64-clm4k"]
Jul 28 01:21:06.516768 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.516754    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a206ef69-3a05-45d8-91d6-38600ba2da8e" containerName="manager"
Jul 28 01:21:06.516819 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.516771    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a206ef69-3a05-45d8-91d6-38600ba2da8e" containerName="manager"
Jul 28 01:21:06.516865 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.516843    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a206ef69-3a05-45d8-91d6-38600ba2da8e" containerName="manager"
Jul 28 01:21:06.521268 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.521253    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58449fbb64-clm4k"
Jul 28 01:21:06.525967 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.525947    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-22sxl\""
Jul 28 01:21:06.525967 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.525966    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 28 01:21:06.526161 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.525995    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 28 01:21:06.547880 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.547852    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58449fbb64-clm4k"]
Jul 28 01:21:06.651467 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.651366    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knrzl\" (UniqueName: \"kubernetes.io/projected/30280f81-8595-4075-97c8-9ac8066aa5da-kube-api-access-knrzl\") pod \"maas-controller-58449fbb64-clm4k\" (UID: \"30280f81-8595-4075-97c8-9ac8066aa5da\") " pod="opendatahub/maas-controller-58449fbb64-clm4k"
Jul 28 01:21:06.651467 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.651406    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30280f81-8595-4075-97c8-9ac8066aa5da-webhook-cert\") pod \"maas-controller-58449fbb64-clm4k\" (UID: \"30280f81-8595-4075-97c8-9ac8066aa5da\") " pod="opendatahub/maas-controller-58449fbb64-clm4k"
Jul 28 01:21:06.752209 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.752172    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knrzl\" (UniqueName: \"kubernetes.io/projected/30280f81-8595-4075-97c8-9ac8066aa5da-kube-api-access-knrzl\") pod \"maas-controller-58449fbb64-clm4k\" (UID: \"30280f81-8595-4075-97c8-9ac8066aa5da\") " pod="opendatahub/maas-controller-58449fbb64-clm4k"
Jul 28 01:21:06.752386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.752217    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30280f81-8595-4075-97c8-9ac8066aa5da-webhook-cert\") pod \"maas-controller-58449fbb64-clm4k\" (UID: \"30280f81-8595-4075-97c8-9ac8066aa5da\") " pod="opendatahub/maas-controller-58449fbb64-clm4k"
Jul 28 01:21:06.755199 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.755174    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30280f81-8595-4075-97c8-9ac8066aa5da-webhook-cert\") pod \"maas-controller-58449fbb64-clm4k\" (UID: \"30280f81-8595-4075-97c8-9ac8066aa5da\") " pod="opendatahub/maas-controller-58449fbb64-clm4k"
Jul 28 01:21:06.762342 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.762320    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knrzl\" (UniqueName: \"kubernetes.io/projected/30280f81-8595-4075-97c8-9ac8066aa5da-kube-api-access-knrzl\") pod \"maas-controller-58449fbb64-clm4k\" (UID: \"30280f81-8595-4075-97c8-9ac8066aa5da\") " pod="opendatahub/maas-controller-58449fbb64-clm4k"
Jul 28 01:21:06.831008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.830976    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58449fbb64-clm4k"
Jul 28 01:21:06.974587 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.974563    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58449fbb64-clm4k"]
Jul 28 01:21:06.975428 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:21:06.975399    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30280f81_8595_4075_97c8_9ac8066aa5da.slice/crio-5cfe1ee79d055b4e7aaf34921747553cb417e2b4eafc32445c413db79659bc42 WatchSource:0}: Error finding container 5cfe1ee79d055b4e7aaf34921747553cb417e2b4eafc32445c413db79659bc42: Status 404 returned error can't find the container with id 5cfe1ee79d055b4e7aaf34921747553cb417e2b4eafc32445c413db79659bc42
Jul 28 01:21:06.976930 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:06.976908    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:21:07.737270 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:07.737168    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58449fbb64-clm4k" event={"ID":"30280f81-8595-4075-97c8-9ac8066aa5da","Type":"ContainerStarted","Data":"82e7824a6f4f5fcf3108706a4d939bfb86ef7be35ba7c6c4225c782b4566aeb6"}
Jul 28 01:21:07.737270 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:07.737225    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58449fbb64-clm4k" event={"ID":"30280f81-8595-4075-97c8-9ac8066aa5da","Type":"ContainerStarted","Data":"5cfe1ee79d055b4e7aaf34921747553cb417e2b4eafc32445c413db79659bc42"}
Jul 28 01:21:07.737270 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:07.737258    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58449fbb64-clm4k"
Jul 28 01:21:07.754701 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:07.754656    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58449fbb64-clm4k" podStartSLOduration=1.290205494 podStartE2EDuration="1.75464088s" totalImagesPullingTime="464.435386ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:21:07.752836834 +0000 UTC m=+1000.367144906" watchObservedRunningTime="2026-07-28 01:21:07.75464088 +0000 UTC m=+1000.368948952"
Jul 28 01:21:18.745113 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:18.745073    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58449fbb64-clm4k"
Jul 28 01:21:40.658572 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:40.658532    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:40.759385 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:40.759348    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:40.873785 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:40.872809    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:46.762289 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:46.762255    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:46.863382 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:46.863345    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:47.004651 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:47.004610    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:47.162745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:47.162715    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:52.890863 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:52.890832    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:21:52.991271 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:21:52.991243    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:10.435693 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:22:10.435660    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:22:10.492529 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:22:10.492499    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:23:08.153965 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:23:08.153928    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:26:09.325001 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:26:09.324959    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:26:10.625452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:26:10.625410    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:28:17.269852 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:28:17.269821    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:28:17.355962 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:28:17.355919    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:29:46.364684 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:29:46.364640    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:29:47.511963 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:29:47.511930    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:29:53.515299 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:29:53.515264    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:30:00.135984 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:00.135948    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4"]
Jul 28 01:30:00.139576 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:00.139560    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4"
Jul 28 01:30:00.141920 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:00.141896    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ck8gn\""
Jul 28 01:30:00.146064 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:00.146037    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4"]
Jul 28 01:30:00.152652 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:00.152629    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4"
Jul 28 01:30:00.300877 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:00.300851    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4"]
Jul 28 01:30:00.302402 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:30:00.302377    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684c5e7c_d3ab_4d2c_bffd_33bad9ec7a24.slice/crio-5371aa65248ac7956678dd90999adcd910576ceef1d3a6a05834d9aca00afb12 WatchSource:0}: Error finding container 5371aa65248ac7956678dd90999adcd910576ceef1d3a6a05834d9aca00afb12: Status 404 returned error can't find the container with id 5371aa65248ac7956678dd90999adcd910576ceef1d3a6a05834d9aca00afb12
Jul 28 01:30:00.304263 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:00.304245    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:30:00.769520 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:00.769485    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4" event={"ID":"684c5e7c-d3ab-4d2c-bffd-33bad9ec7a24","Type":"ContainerStarted","Data":"5371aa65248ac7956678dd90999adcd910576ceef1d3a6a05834d9aca00afb12"}
Jul 28 01:30:03.789905 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:03.789870    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4" event={"ID":"684c5e7c-d3ab-4d2c-bffd-33bad9ec7a24","Type":"ContainerStarted","Data":"ea5f54c49690a2ee74fca7e6c5fc7320fe58619d72e3806a8b129cb6d7e8f7bd"}
Jul 28 01:30:03.804845 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:03.804792    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4" podStartSLOduration=1.032795547 podStartE2EDuration="3.804776749s" totalImagesPullingTime="2.771981202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:30:03.803979695 +0000 UTC m=+1536.418287769" watchObservedRunningTime="2026-07-28 01:30:03.804776749 +0000 UTC m=+1536.419084821"
Jul 28 01:30:04.796983 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:04.796946    2552 generic.go:356] "Generic (PLEG): container finished" podID="684c5e7c-d3ab-4d2c-bffd-33bad9ec7a24" containerID="ea5f54c49690a2ee74fca7e6c5fc7320fe58619d72e3806a8b129cb6d7e8f7bd" exitCode=0
Jul 28 01:30:04.797461 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:04.796996    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4" event={"ID":"684c5e7c-d3ab-4d2c-bffd-33bad9ec7a24","Type":"ContainerDied","Data":"ea5f54c49690a2ee74fca7e6c5fc7320fe58619d72e3806a8b129cb6d7e8f7bd"}
Jul 28 01:30:05.940920 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:05.940890    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4"
Jul 28 01:30:06.815321 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:06.815288    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4"
Jul 28 01:30:06.815501 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:06.815339    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753370-7znv4" event={"ID":"684c5e7c-d3ab-4d2c-bffd-33bad9ec7a24","Type":"ContainerDied","Data":"5371aa65248ac7956678dd90999adcd910576ceef1d3a6a05834d9aca00afb12"}
Jul 28 01:30:06.815501 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:06.815408    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5371aa65248ac7956678dd90999adcd910576ceef1d3a6a05834d9aca00afb12"
Jul 28 01:30:20.293274 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:20.293239    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:30:21.834820 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:30:21.834789    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:32:08.949276 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:32:08.949238    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:32:10.929684 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:32:10.929637    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:32:43.963735 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:32:43.963693    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:28.221518 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:28.221474    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:49.704665 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:49.704632    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:52.676524 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:52.676486    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:52.777885 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:52.777846    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:53.097592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:53.097508    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:59.003848 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.003804    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:59.104724 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.104688    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:59.234953 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.234921    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:59.505717 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.505687    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"]
Jul 28 01:33:59.506107 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.506095    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="684c5e7c-d3ab-4d2c-bffd-33bad9ec7a24" containerName="cleanup"
Jul 28 01:33:59.506169 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.506109    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="684c5e7c-d3ab-4d2c-bffd-33bad9ec7a24" containerName="cleanup"
Jul 28 01:33:59.506232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.506222    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="684c5e7c-d3ab-4d2c-bffd-33bad9ec7a24" containerName="cleanup"
Jul 28 01:33:59.509717 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.509697    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.513641 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.513623    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5ce185b9-openshift-default-dockercfg-8rb68\""
Jul 28 01:33:59.541740 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.541717    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"]
Jul 28 01:33:59.545824 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.545796    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:59.608600 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.608564    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-certs\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.608600 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.608611    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43ef31f7-207f-40b5-af3a-482a0bb77513-istiod-ca-cert\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.608878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.608702    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-podinfo\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.608878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.608734    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m7lr\" (UniqueName: \"kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-kube-api-access-6m7lr\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.608878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.608766    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-socket\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.608878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.608808    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-credential-socket\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.608878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.608829    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-data\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.609190 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.608886    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-envoy\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.609190 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.608926    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-token\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710066 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710031    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-envoy\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710066 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710067    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-token\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710343 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710095    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-certs\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710343 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710120    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43ef31f7-207f-40b5-af3a-482a0bb77513-istiod-ca-cert\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710343 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710194    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-podinfo\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710343 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710218    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7lr\" (UniqueName: \"kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-kube-api-access-6m7lr\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710343 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710248    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-socket\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710343 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710303    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-credential-socket\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710343 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710325    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-data\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710718 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710541    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-certs\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710718 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710694    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-socket\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710933 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710719    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-data\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710933 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710800    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-credential-socket\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.710933 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.710875    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43ef31f7-207f-40b5-af3a-482a0bb77513-istiod-ca-cert\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.712598 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.712573    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-envoy\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.712728 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.712685    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-podinfo\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.719306 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.719282    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7lr\" (UniqueName: \"kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-kube-api-access-6m7lr\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.719470 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.719453    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-token\") pod \"e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") " pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.820233 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.820152    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:33:59.830625 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.830601    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:33:59.965107 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.965066    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"]
Jul 28 01:33:59.966590 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:33:59.966567    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ef31f7_207f_40b5_af3a_482a0bb77513.slice/crio-fa87081e03ba247b94fb0f8eb4b4cd6a1ed3b82840d698ec7b5a8324e416ff83 WatchSource:0}: Error finding container fa87081e03ba247b94fb0f8eb4b4cd6a1ed3b82840d698ec7b5a8324e416ff83: Status 404 returned error can't find the container with id fa87081e03ba247b94fb0f8eb4b4cd6a1ed3b82840d698ec7b5a8324e416ff83
Jul 28 01:33:59.969336 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.969297    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:33:59.969417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.969390    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:33:59.969453 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:33:59.969436    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:34:00.142001 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:00.141957    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" event={"ID":"43ef31f7-207f-40b5-af3a-482a0bb77513","Type":"ContainerStarted","Data":"652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a"}
Jul 28 01:34:00.142417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:00.142032    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" event={"ID":"43ef31f7-207f-40b5-af3a-482a0bb77513","Type":"ContainerStarted","Data":"fa87081e03ba247b94fb0f8eb4b4cd6a1ed3b82840d698ec7b5a8324e416ff83"}
Jul 28 01:34:00.185894 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:00.185841    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" podStartSLOduration=1.185823412 podStartE2EDuration="1.185823412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:33:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:34:00.183499575 +0000 UTC m=+1772.797807649" watchObservedRunningTime="2026-07-28 01:34:00.185823412 +0000 UTC m=+1772.800131483"
Jul 28 01:34:00.820572 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:00.820536    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:34:01.536055 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:01.536020    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:01.635747 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:01.635710    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:01.712295 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:01.712241    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:01.827099 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:01.827019    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:34:01.834404 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:01.834375    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:02.154730 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.154697    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:34:02.155626 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.155606    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:34:02.248835 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.248790    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:02.347394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.347359    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:02.433889 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.433793    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"]
Jul 28 01:34:02.437625 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.437602    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:02.440024 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.440004    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-5ce185b9\""
Jul 28 01:34:02.440161 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.440052    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-5ce185b9-dockercfg-6hxg8\""
Jul 28 01:34:02.449183 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.449155    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"]
Jul 28 01:34:02.501158 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.501111    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"]
Jul 28 01:34:02.504935 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.504906    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:02.516679 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.516655    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"]
Jul 28 01:34:02.537726 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.537690    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3cade77-06ea-46eb-9ea9-87bb64357a63-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt\" (UID: \"b3cade77-06ea-46eb-9ea9-87bb64357a63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:02.538153 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.537861    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgzwj\" (UniqueName: \"kubernetes.io/projected/b3cade77-06ea-46eb-9ea9-87bb64357a63-kube-api-access-hgzwj\") pod \"payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt\" (UID: \"b3cade77-06ea-46eb-9ea9-87bb64357a63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:02.638596 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.638558    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b752x\" (UniqueName: \"kubernetes.io/projected/7c659526-e112-47ea-9d2d-fdaaf96456a8-kube-api-access-b752x\") pod \"payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg\" (UID: \"7c659526-e112-47ea-9d2d-fdaaf96456a8\") " pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:02.638596 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.638599    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgzwj\" (UniqueName: \"kubernetes.io/projected/b3cade77-06ea-46eb-9ea9-87bb64357a63-kube-api-access-hgzwj\") pod \"payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt\" (UID: \"b3cade77-06ea-46eb-9ea9-87bb64357a63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:02.638807 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.638618    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c659526-e112-47ea-9d2d-fdaaf96456a8-plugins-config-volume\") pod \"payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg\" (UID: \"7c659526-e112-47ea-9d2d-fdaaf96456a8\") " pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:02.638807 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.638692    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3cade77-06ea-46eb-9ea9-87bb64357a63-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt\" (UID: \"b3cade77-06ea-46eb-9ea9-87bb64357a63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:02.639419 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.639399    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3cade77-06ea-46eb-9ea9-87bb64357a63-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt\" (UID: \"b3cade77-06ea-46eb-9ea9-87bb64357a63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:02.646746 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.646719    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgzwj\" (UniqueName: \"kubernetes.io/projected/b3cade77-06ea-46eb-9ea9-87bb64357a63-kube-api-access-hgzwj\") pod \"payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt\" (UID: \"b3cade77-06ea-46eb-9ea9-87bb64357a63\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:02.739461 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.739371    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b752x\" (UniqueName: \"kubernetes.io/projected/7c659526-e112-47ea-9d2d-fdaaf96456a8-kube-api-access-b752x\") pod \"payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg\" (UID: \"7c659526-e112-47ea-9d2d-fdaaf96456a8\") " pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:02.739461 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.739414    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c659526-e112-47ea-9d2d-fdaaf96456a8-plugins-config-volume\") pod \"payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg\" (UID: \"7c659526-e112-47ea-9d2d-fdaaf96456a8\") " pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:02.740279 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.740257    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c659526-e112-47ea-9d2d-fdaaf96456a8-plugins-config-volume\") pod \"payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg\" (UID: \"7c659526-e112-47ea-9d2d-fdaaf96456a8\") " pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:02.747873 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.747854    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b752x\" (UniqueName: \"kubernetes.io/projected/7c659526-e112-47ea-9d2d-fdaaf96456a8-kube-api-access-b752x\") pod \"payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg\" (UID: \"7c659526-e112-47ea-9d2d-fdaaf96456a8\") " pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:02.749695 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.749679    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:02.816784 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.816615    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:02.904478 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.904450    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"]
Jul 28 01:34:02.906521 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:34:02.906487    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cade77_06ea_46eb_9ea9_87bb64357a63.slice/crio-09385517e078ab664ba82b24c6aef868e6b5eb29582f0208d1e9ba46cbd914d7 WatchSource:0}: Error finding container 09385517e078ab664ba82b24c6aef868e6b5eb29582f0208d1e9ba46cbd914d7: Status 404 returned error can't find the container with id 09385517e078ab664ba82b24c6aef868e6b5eb29582f0208d1e9ba46cbd914d7
Jul 28 01:34:02.990157 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:02.990071    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"]
Jul 28 01:34:02.993822 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:34:02.993791    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c659526_e112_47ea_9d2d_fdaaf96456a8.slice/crio-8794dcddbefb028b10a5c50221a35fb898c1c7273866836c82ca6384f7783597 WatchSource:0}: Error finding container 8794dcddbefb028b10a5c50221a35fb898c1c7273866836c82ca6384f7783597: Status 404 returned error can't find the container with id 8794dcddbefb028b10a5c50221a35fb898c1c7273866836c82ca6384f7783597
Jul 28 01:34:03.162880 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:03.162837    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt" event={"ID":"b3cade77-06ea-46eb-9ea9-87bb64357a63","Type":"ContainerStarted","Data":"73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a"}
Jul 28 01:34:03.163043 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:03.162908    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt" event={"ID":"b3cade77-06ea-46eb-9ea9-87bb64357a63","Type":"ContainerStarted","Data":"09385517e078ab664ba82b24c6aef868e6b5eb29582f0208d1e9ba46cbd914d7"}
Jul 28 01:34:03.163704 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:03.163676    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:03.166695 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:03.166665    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg" event={"ID":"7c659526-e112-47ea-9d2d-fdaaf96456a8","Type":"ContainerStarted","Data":"3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73"}
Jul 28 01:34:03.166889 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:03.166719    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:03.166889 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:03.166741    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg" event={"ID":"7c659526-e112-47ea-9d2d-fdaaf96456a8","Type":"ContainerStarted","Data":"8794dcddbefb028b10a5c50221a35fb898c1c7273866836c82ca6384f7783597"}
Jul 28 01:34:03.206557 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:03.206506    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt" podStartSLOduration=1.206489801 podStartE2EDuration="1.206489801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:34:03.182583869 +0000 UTC m=+1775.796891941" watchObservedRunningTime="2026-07-28 01:34:03.206489801 +0000 UTC m=+1775.820797929"
Jul 28 01:34:03.207044 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:03.207021    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg" podStartSLOduration=1.207015829 podStartE2EDuration="1.207015829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:34:03.204778548 +0000 UTC m=+1775.819086619" watchObservedRunningTime="2026-07-28 01:34:03.207015829 +0000 UTC m=+1775.821323911"
Jul 28 01:34:14.173238 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:14.173200    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:15.179249 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:15.179218    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:15.237658 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:15.237621    2552 generic.go:356] "Generic (PLEG): container finished" podID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerID="652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a" exitCode=0
Jul 28 01:34:15.237862 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:15.237698    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" event={"ID":"43ef31f7-207f-40b5-af3a-482a0bb77513","Type":"ContainerDied","Data":"652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a"}
Jul 28 01:34:15.238176 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:15.238160    2552 scope.go:117] "RemoveContainer" containerID="652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a"
Jul 28 01:34:15.239239 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:15.239211    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:34:15.239318 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:15.239278    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:34:15.239318 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:15.239311    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:34:16.245830 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:16.245800    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" event={"ID":"43ef31f7-207f-40b5-af3a-482a0bb77513","Type":"ContainerStarted","Data":"10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249"}
Jul 28 01:34:16.820986 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:16.820952    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:34:16.821953 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:16.821931    2552 patch_prober.go:28] interesting pod/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 28 01:34:16.822045 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:16.821976    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 28 01:34:17.154805 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:17.154775    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:34:17.821318 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:17.821282    2552 patch_prober.go:28] interesting pod/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 28 01:34:17.821687 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:17.821340    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 28 01:34:18.821506 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:18.821468    2552 patch_prober.go:28] interesting pod/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 28 01:34:18.821911 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:18.821530    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 28 01:34:19.821250 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:19.821210    2552 patch_prober.go:28] interesting pod/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 28 01:34:19.821440 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:19.821267    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 28 01:34:20.824605 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:20.824576    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:34:20.825617 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:20.825596    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:34:42.598825 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.598789    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:42.640103 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.640063    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"]
Jul 28 01:34:42.640389 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.640354    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg" podUID="7c659526-e112-47ea-9d2d-fdaaf96456a8" containerName="payload-processing" containerID="cri-o://3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73" gracePeriod=30
Jul 28 01:34:42.650676 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.650638    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"]
Jul 28 01:34:42.650990 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.650941    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt" podUID="b3cade77-06ea-46eb-9ea9-87bb64357a63" containerName="payload-pre-processing" containerID="cri-o://73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a" gracePeriod=30
Jul 28 01:34:42.706788 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.706758    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:42.797351 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.797297    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:42.869389 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.869214    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:42.910270 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.910243    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:42.941403 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.941373    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:42.997952 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.997917    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"]
Jul 28 01:34:42.998200 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:42.998172    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy" containerID="cri-o://10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249" gracePeriod=30
Jul 28 01:34:43.028211 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.028175    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b752x\" (UniqueName: \"kubernetes.io/projected/7c659526-e112-47ea-9d2d-fdaaf96456a8-kube-api-access-b752x\") pod \"7c659526-e112-47ea-9d2d-fdaaf96456a8\" (UID: \"7c659526-e112-47ea-9d2d-fdaaf96456a8\") "
Jul 28 01:34:43.028429 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.028404    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c659526-e112-47ea-9d2d-fdaaf96456a8-plugins-config-volume\") pod \"7c659526-e112-47ea-9d2d-fdaaf96456a8\" (UID: \"7c659526-e112-47ea-9d2d-fdaaf96456a8\") "
Jul 28 01:34:43.028529 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.028497    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgzwj\" (UniqueName: \"kubernetes.io/projected/b3cade77-06ea-46eb-9ea9-87bb64357a63-kube-api-access-hgzwj\") pod \"b3cade77-06ea-46eb-9ea9-87bb64357a63\" (UID: \"b3cade77-06ea-46eb-9ea9-87bb64357a63\") "
Jul 28 01:34:43.028613 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.028596    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3cade77-06ea-46eb-9ea9-87bb64357a63-plugins-config-volume\") pod \"b3cade77-06ea-46eb-9ea9-87bb64357a63\" (UID: \"b3cade77-06ea-46eb-9ea9-87bb64357a63\") "
Jul 28 01:34:43.028782 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.028762    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c659526-e112-47ea-9d2d-fdaaf96456a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c659526-e112-47ea-9d2d-fdaaf96456a8" (UID: "7c659526-e112-47ea-9d2d-fdaaf96456a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:34:43.029018 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.028997    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c659526-e112-47ea-9d2d-fdaaf96456a8-plugins-config-volume\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:43.029242 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.029121    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3cade77-06ea-46eb-9ea9-87bb64357a63-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b3cade77-06ea-46eb-9ea9-87bb64357a63" (UID: "b3cade77-06ea-46eb-9ea9-87bb64357a63"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:34:43.029534 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.029513    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:43.030612 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.030590    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c659526-e112-47ea-9d2d-fdaaf96456a8-kube-api-access-b752x" (OuterVolumeSpecName: "kube-api-access-b752x") pod "7c659526-e112-47ea-9d2d-fdaaf96456a8" (UID: "7c659526-e112-47ea-9d2d-fdaaf96456a8"). InnerVolumeSpecName "kube-api-access-b752x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:34:43.030936 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.030916    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3cade77-06ea-46eb-9ea9-87bb64357a63-kube-api-access-hgzwj" (OuterVolumeSpecName: "kube-api-access-hgzwj") pod "b3cade77-06ea-46eb-9ea9-87bb64357a63" (UID: "b3cade77-06ea-46eb-9ea9-87bb64357a63"). InnerVolumeSpecName "kube-api-access-hgzwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:34:43.129847 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.129760    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgzwj\" (UniqueName: \"kubernetes.io/projected/b3cade77-06ea-46eb-9ea9-87bb64357a63-kube-api-access-hgzwj\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:43.129847 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.129791    2552 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3cade77-06ea-46eb-9ea9-87bb64357a63-plugins-config-volume\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:43.129847 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.129801    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b752x\" (UniqueName: \"kubernetes.io/projected/7c659526-e112-47ea-9d2d-fdaaf96456a8-kube-api-access-b752x\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:43.249589 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.249551    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:43.408784 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.408751    2552 generic.go:356] "Generic (PLEG): container finished" podID="7c659526-e112-47ea-9d2d-fdaaf96456a8" containerID="3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73" exitCode=0
Jul 28 01:34:43.409010 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.408796    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"
Jul 28 01:34:43.409010 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.408836    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg" event={"ID":"7c659526-e112-47ea-9d2d-fdaaf96456a8","Type":"ContainerDied","Data":"3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73"}
Jul 28 01:34:43.409010 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.408887    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg" event={"ID":"7c659526-e112-47ea-9d2d-fdaaf96456a8","Type":"ContainerDied","Data":"8794dcddbefb028b10a5c50221a35fb898c1c7273866836c82ca6384f7783597"}
Jul 28 01:34:43.409010 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.408923    2552 scope.go:117] "RemoveContainer" containerID="3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73"
Jul 28 01:34:43.410290 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.410266    2552 generic.go:356] "Generic (PLEG): container finished" podID="b3cade77-06ea-46eb-9ea9-87bb64357a63" containerID="73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a" exitCode=0
Jul 28 01:34:43.410403 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.410303    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"
Jul 28 01:34:43.410403 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.410377    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt" event={"ID":"b3cade77-06ea-46eb-9ea9-87bb64357a63","Type":"ContainerDied","Data":"73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a"}
Jul 28 01:34:43.410514 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.410421    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt" event={"ID":"b3cade77-06ea-46eb-9ea9-87bb64357a63","Type":"ContainerDied","Data":"09385517e078ab664ba82b24c6aef868e6b5eb29582f0208d1e9ba46cbd914d7"}
Jul 28 01:34:43.428370 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.428347    2552 scope.go:117] "RemoveContainer" containerID="3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73"
Jul 28 01:34:43.428711 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:34:43.428690    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73\": container with ID starting with 3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73 not found: ID does not exist" containerID="3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73"
Jul 28 01:34:43.428756 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.428720    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73"} err="failed to get container status \"3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73\": rpc error: code = NotFound desc = could not find container \"3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73\": container with ID starting with 3a46d4d163f01aed019454b973f9fd6ac1ccbc9695cee4647af6eb3fc37cdb73 not found: ID does not exist"
Jul 28 01:34:43.428756 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.428737    2552 scope.go:117] "RemoveContainer" containerID="73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a"
Jul 28 01:34:43.443012 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.442982    2552 scope.go:117] "RemoveContainer" containerID="73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a"
Jul 28 01:34:43.443581 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:34:43.443556    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a\": container with ID starting with 73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a not found: ID does not exist" containerID="73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a"
Jul 28 01:34:43.443706 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.443593    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a"} err="failed to get container status \"73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a\": rpc error: code = NotFound desc = could not find container \"73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a\": container with ID starting with 73cbaad49eb419604218ec021fb47a72abd1fd62f451dfba526ff6b4bd1c2e1a not found: ID does not exist"
Jul 28 01:34:43.454187 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.454154    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"]
Jul 28 01:34:43.455148 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:34:43.455098    2552 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cade77_06ea_46eb_9ea9_87bb64357a63.slice/crio-09385517e078ab664ba82b24c6aef868e6b5eb29582f0208d1e9ba46cbd914d7\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c659526_e112_47ea_9d2d_fdaaf96456a8.slice\": RecentStats: unable to find data in memory cache]"
Jul 28 01:34:43.458763 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.458740    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5ce185b9-9fb5f8fd4-p2wmg"]
Jul 28 01:34:43.517980 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.517938    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"]
Jul 28 01:34:43.549151 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.549103    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5ce185b9-64695cddbd-tzwvt"]
Jul 28 01:34:43.588433 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.588398    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:43.714027 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.713944    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:43.808257 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:43.808221    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:44.023583 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.023505    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c659526-e112-47ea-9d2d-fdaaf96456a8" path="/var/lib/kubelet/pods/7c659526-e112-47ea-9d2d-fdaaf96456a8/volumes"
Jul 28 01:34:44.023872 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.023859    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3cade77-06ea-46eb-9ea9-87bb64357a63" path="/var/lib/kubelet/pods/b3cade77-06ea-46eb-9ea9-87bb64357a63/volumes"
Jul 28 01:34:44.079369 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.079342    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"]
Jul 28 01:34:44.079758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.079746    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c659526-e112-47ea-9d2d-fdaaf96456a8" containerName="payload-processing"
Jul 28 01:34:44.079800 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.079760    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c659526-e112-47ea-9d2d-fdaaf96456a8" containerName="payload-processing"
Jul 28 01:34:44.079800 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.079783    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3cade77-06ea-46eb-9ea9-87bb64357a63" containerName="payload-pre-processing"
Jul 28 01:34:44.079800 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.079788    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3cade77-06ea-46eb-9ea9-87bb64357a63" containerName="payload-pre-processing"
Jul 28 01:34:44.079894 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.079848    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c659526-e112-47ea-9d2d-fdaaf96456a8" containerName="payload-processing"
Jul 28 01:34:44.079894 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.079861    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3cade77-06ea-46eb-9ea9-87bb64357a63" containerName="payload-pre-processing"
Jul 28 01:34:44.084596 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.084576    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.088827 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.088810    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b70cb0d5-gw-openshift-default-dockercfg-2wnxb\""
Jul 28 01:34:44.100549 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.100525    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"]
Jul 28 01:34:44.108066 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.108043    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:44.137240 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.137214    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-certs\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.137396 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.137250    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/479b3255-0e59-4670-999a-77c2d7357107-istiod-ca-cert\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.137396 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.137281    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-data\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.137396 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.137353    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/479b3255-0e59-4670-999a-77c2d7357107-istio-podinfo\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.137396 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.137389    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-socket\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.137599 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.137409    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-credential-socket\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.137599 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.137426    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-envoy\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.137599 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.137503    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmkp8\" (UniqueName: \"kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-kube-api-access-zmkp8\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.137599 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.137591    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-istio-token\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.238630 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.238591    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-certs\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.238630 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.238628    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/479b3255-0e59-4670-999a-77c2d7357107-istiod-ca-cert\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.238878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.238659    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-data\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.238878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.238682    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/479b3255-0e59-4670-999a-77c2d7357107-istio-podinfo\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.238878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.238714    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-socket\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.238878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.238735    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-credential-socket\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.238878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.238751    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-envoy\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.238878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.238787    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmkp8\" (UniqueName: \"kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-kube-api-access-zmkp8\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.238878 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.238855    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-istio-token\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.239508 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.239190    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-data\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.239508 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.239218    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-certs\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.239508 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.239282    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-socket\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.239508 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.239348    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-credential-socket\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.239643 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.239529    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/479b3255-0e59-4670-999a-77c2d7357107-istiod-ca-cert\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.241382 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.241357    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-envoy\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.241522 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.241506    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/479b3255-0e59-4670-999a-77c2d7357107-istio-podinfo\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.248730 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.248711    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-istio-token\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.248870 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.248852    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmkp8\" (UniqueName: \"kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-kube-api-access-zmkp8\") pod \"e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") " pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.276892 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.276824    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:44.395263 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.395232    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:44.543332 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.543305    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"]
Jul 28 01:34:44.545510 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:34:44.545475    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479b3255_0e59_4670_999a_77c2d7357107.slice/crio-c796f49e0853f81312e74d08e1409d261957866725aeaddad6e2be8961509c34 WatchSource:0}: Error finding container c796f49e0853f81312e74d08e1409d261957866725aeaddad6e2be8961509c34: Status 404 returned error can't find the container with id c796f49e0853f81312e74d08e1409d261957866725aeaddad6e2be8961509c34
Jul 28 01:34:44.547631 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.547592    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:34:44.547684 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.547659    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:34:44.547725 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:44.547693    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:34:45.426859 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:45.426825    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" event={"ID":"479b3255-0e59-4670-999a-77c2d7357107","Type":"ContainerStarted","Data":"ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152"}
Jul 28 01:34:45.427265 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:45.426873    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" event={"ID":"479b3255-0e59-4670-999a-77c2d7357107","Type":"ContainerStarted","Data":"c796f49e0853f81312e74d08e1409d261957866725aeaddad6e2be8961509c34"}
Jul 28 01:34:45.456978 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:45.456901    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" podStartSLOduration=1.45688332 podStartE2EDuration="1.45688332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:34:45.456220395 +0000 UTC m=+1818.070528467" watchObservedRunningTime="2026-07-28 01:34:45.45688332 +0000 UTC m=+1818.071191394"
Jul 28 01:34:46.396238 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:46.396204    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:46.401311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:46.401280    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:46.432375 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:46.432343    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:46.433357 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:46.433338    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:34:46.928853 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:46.928812    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:47.117816 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:47.117778    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:47.424731 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:47.424703    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:47.813325 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:47.813230    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:47.912969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:47.912926    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:34:48.260792 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.260755    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:34:48.282927 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.282886    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-podinfo\") pod \"43ef31f7-207f-40b5-af3a-482a0bb77513\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") "
Jul 28 01:34:48.283117 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.282937    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-data\") pod \"43ef31f7-207f-40b5-af3a-482a0bb77513\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") "
Jul 28 01:34:48.283117 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.282970    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43ef31f7-207f-40b5-af3a-482a0bb77513-istiod-ca-cert\") pod \"43ef31f7-207f-40b5-af3a-482a0bb77513\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") "
Jul 28 01:34:48.283117 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.283008    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-socket\") pod \"43ef31f7-207f-40b5-af3a-482a0bb77513\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") "
Jul 28 01:34:48.283117 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.283084    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-certs\") pod \"43ef31f7-207f-40b5-af3a-482a0bb77513\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") "
Jul 28 01:34:48.283117 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.283113    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-envoy\") pod \"43ef31f7-207f-40b5-af3a-482a0bb77513\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") "
Jul 28 01:34:48.283681 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.283166    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m7lr\" (UniqueName: \"kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-kube-api-access-6m7lr\") pod \"43ef31f7-207f-40b5-af3a-482a0bb77513\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") "
Jul 28 01:34:48.283681 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.283193    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-token\") pod \"43ef31f7-207f-40b5-af3a-482a0bb77513\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") "
Jul 28 01:34:48.283681 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.283235    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-credential-socket\") pod \"43ef31f7-207f-40b5-af3a-482a0bb77513\" (UID: \"43ef31f7-207f-40b5-af3a-482a0bb77513\") "
Jul 28 01:34:48.283681 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.283610    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "43ef31f7-207f-40b5-af3a-482a0bb77513" (UID: "43ef31f7-207f-40b5-af3a-482a0bb77513"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:34:48.284293 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.284208    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-data" (OuterVolumeSpecName: "istio-data") pod "43ef31f7-207f-40b5-af3a-482a0bb77513" (UID: "43ef31f7-207f-40b5-af3a-482a0bb77513"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:34:48.284708 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.284667    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43ef31f7-207f-40b5-af3a-482a0bb77513-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "43ef31f7-207f-40b5-af3a-482a0bb77513" (UID: "43ef31f7-207f-40b5-af3a-482a0bb77513"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:34:48.285271 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.285236    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "43ef31f7-207f-40b5-af3a-482a0bb77513" (UID: "43ef31f7-207f-40b5-af3a-482a0bb77513"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:34:48.285872 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.285797    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "43ef31f7-207f-40b5-af3a-482a0bb77513" (UID: "43ef31f7-207f-40b5-af3a-482a0bb77513"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:34:48.286231 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.286183    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "43ef31f7-207f-40b5-af3a-482a0bb77513" (UID: "43ef31f7-207f-40b5-af3a-482a0bb77513"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:34:48.287538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.287510    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-kube-api-access-6m7lr" (OuterVolumeSpecName: "kube-api-access-6m7lr") pod "43ef31f7-207f-40b5-af3a-482a0bb77513" (UID: "43ef31f7-207f-40b5-af3a-482a0bb77513"). InnerVolumeSpecName "kube-api-access-6m7lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:34:48.287636 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.287565    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "43ef31f7-207f-40b5-af3a-482a0bb77513" (UID: "43ef31f7-207f-40b5-af3a-482a0bb77513"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:34:48.287953 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.287934    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-token" (OuterVolumeSpecName: "istio-token") pod "43ef31f7-207f-40b5-af3a-482a0bb77513" (UID: "43ef31f7-207f-40b5-af3a-482a0bb77513"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:34:48.385005 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.384977    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:48.385005 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.385004    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:48.385221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.385013    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:48.385221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.385023    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43ef31f7-207f-40b5-af3a-482a0bb77513-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:48.385221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.385032    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:48.385221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.385040    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:48.385221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.385047    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:48.385221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.385055    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m7lr\" (UniqueName: \"kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-kube-api-access-6m7lr\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:48.385221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.385063    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ef31f7-207f-40b5-af3a-482a0bb77513-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:34:48.444690 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.444655    2552 generic.go:356] "Generic (PLEG): container finished" podID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerID="10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249" exitCode=0
Jul 28 01:34:48.444873 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.444704    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"
Jul 28 01:34:48.444873 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.444735    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" event={"ID":"43ef31f7-207f-40b5-af3a-482a0bb77513","Type":"ContainerDied","Data":"10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249"}
Jul 28 01:34:48.444873 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.444798    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs" event={"ID":"43ef31f7-207f-40b5-af3a-482a0bb77513","Type":"ContainerDied","Data":"fa87081e03ba247b94fb0f8eb4b4cd6a1ed3b82840d698ec7b5a8324e416ff83"}
Jul 28 01:34:48.444873 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.444829    2552 scope.go:117] "RemoveContainer" containerID="10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249"
Jul 28 01:34:48.454804 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.454784    2552 scope.go:117] "RemoveContainer" containerID="652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a"
Jul 28 01:34:48.463169 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.463122    2552 scope.go:117] "RemoveContainer" containerID="10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249"
Jul 28 01:34:48.463426 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:34:48.463405    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249\": container with ID starting with 10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249 not found: ID does not exist" containerID="10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249"
Jul 28 01:34:48.463479 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.463435    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249"} err="failed to get container status \"10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249\": rpc error: code = NotFound desc = could not find container \"10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249\": container with ID starting with 10b5e8add7b18c5928d19e92035773715a07a7a1c55012268e802eec14318249 not found: ID does not exist"
Jul 28 01:34:48.463479 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.463453    2552 scope.go:117] "RemoveContainer" containerID="652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a"
Jul 28 01:34:48.463714 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:34:48.463691    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a\": container with ID starting with 652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a not found: ID does not exist" containerID="652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a"
Jul 28 01:34:48.463750 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.463726    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a"} err="failed to get container status \"652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a\": rpc error: code = NotFound desc = could not find container \"652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a\": container with ID starting with 652924e190a81204cbb154702edc5a9fa368e7e87624dd8abf044a00aa59105a not found: ID does not exist"
Jul 28 01:34:48.497746 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.497723    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"]
Jul 28 01:34:48.505246 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:48.505225    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5ce185b9-openshift-default-7cb9b57d5b-g9mqs"]
Jul 28 01:34:50.022736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:34:50.022701    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" path="/var/lib/kubelet/pods/43ef31f7-207f-40b5-af3a-482a0bb77513/volumes"
Jul 28 01:35:00.526788 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:00.526748    2552 generic.go:356] "Generic (PLEG): container finished" podID="479b3255-0e59-4670-999a-77c2d7357107" containerID="ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152" exitCode=0
Jul 28 01:35:00.526788 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:00.526776    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" event={"ID":"479b3255-0e59-4670-999a-77c2d7357107","Type":"ContainerDied","Data":"ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152"}
Jul 28 01:35:00.527293 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:00.527209    2552 scope.go:117] "RemoveContainer" containerID="ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152"
Jul 28 01:35:00.528239 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:00.528209    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:00.528342 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:00.528279    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:00.528342 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:00.528311    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:01.432934 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:01.432892    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:35:01.536114 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:01.536057    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" event={"ID":"479b3255-0e59-4670-999a-77c2d7357107","Type":"ContainerStarted","Data":"d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5"}
Jul 28 01:35:02.395358 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:02.395322    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:35:02.396736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:02.396709    2552 patch_prober.go:28] interesting pod/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 28 01:35:02.396879 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:02.396764    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 28 01:35:03.396450 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:03.396418    2552 patch_prober.go:28] interesting pod/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 28 01:35:03.396861 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:03.396473    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 28 01:35:04.396247 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:04.396206    2552 patch_prober.go:28] interesting pod/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 28 01:35:04.396440 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:04.396285    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 28 01:35:05.396696 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:05.396654    2552 patch_prober.go:28] interesting pod/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Jul 28 01:35:05.397154 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:05.396714    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Jul 28 01:35:06.399924 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:06.399890    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:35:06.400454 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:06.400326    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:35:06.401285 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:06.401265    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:35:18.481511 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:18.481475    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:18.581870 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:18.581838    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:18.665555 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:18.665515    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:18.730521 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:18.730481    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:18.799286 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:18.799202    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"]
Jul 28 01:35:18.799492 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:18.799465    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy" containerID="cri-o://d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5" gracePeriod=30
Jul 28 01:35:18.825843 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:18.825807    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:19.036973 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.036935    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:19.259452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.259410    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:19.561668 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.561572    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"]
Jul 28 01:35:19.562162 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.562014    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy"
Jul 28 01:35:19.562162 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.562026    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy"
Jul 28 01:35:19.562162 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.562047    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy"
Jul 28 01:35:19.562162 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.562052    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy"
Jul 28 01:35:19.562162 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.562121    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy"
Jul 28 01:35:19.565894 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.565858    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.568523 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.568496    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0fcf74cb-openshift-default-dockercfg-2c2k5\""
Jul 28 01:35:19.579029 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.579002    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"]
Jul 28 01:35:19.588783 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.588743    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:19.684575 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.684541    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-certs\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.684575 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.684579    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-data\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.684814 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.684614    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-credential-socket\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.684814 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.684668    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j2kf\" (UniqueName: \"kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-kube-api-access-4j2kf\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.684814 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.684714    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-envoy\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.684814 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.684743    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-istio-token\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.684814 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.684775    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c1be0a-e32a-404a-b5d0-332e45279743-istio-podinfo\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.684814 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.684798    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c1be0a-e32a-404a-b5d0-332e45279743-istiod-ca-cert\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.685024 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.684824    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-socket\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.737027 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.736982    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:19.786313 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786263    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-credential-socket\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.786313 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786322    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j2kf\" (UniqueName: \"kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-kube-api-access-4j2kf\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.786570 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786371    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-envoy\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.786570 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786412    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-istio-token\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.786570 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786448    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c1be0a-e32a-404a-b5d0-332e45279743-istio-podinfo\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.786570 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786471    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c1be0a-e32a-404a-b5d0-332e45279743-istiod-ca-cert\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.786570 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786512    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-socket\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.786827 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786574    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-certs\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.786827 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786602    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-data\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.786827 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786664    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-credential-socket\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.787033 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786856    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-socket\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.787033 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786963    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-certs\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.787033 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.786980    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-data\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.787494 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.787470    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c1be0a-e32a-404a-b5d0-332e45279743-istiod-ca-cert\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.788840 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.788814    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-envoy\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.789104 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.789087    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c1be0a-e32a-404a-b5d0-332e45279743-istio-podinfo\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.795328 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.795300    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-istio-token\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.795829 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.795805    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j2kf\" (UniqueName: \"kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-kube-api-access-4j2kf\") pod \"e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") " pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:19.876611 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:19.876504    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:20.031028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:20.031000    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"]
Jul 28 01:35:20.032327 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:35:20.032301    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c1be0a_e32a_404a_b5d0_332e45279743.slice/crio-6210d9daf9c61ca58caf9f1b826ad75e0036bf7a48616db0916de9ee077b3214 WatchSource:0}: Error finding container 6210d9daf9c61ca58caf9f1b826ad75e0036bf7a48616db0916de9ee077b3214: Status 404 returned error can't find the container with id 6210d9daf9c61ca58caf9f1b826ad75e0036bf7a48616db0916de9ee077b3214
Jul 28 01:35:20.034876 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:20.034844    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:20.034960 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:20.034911    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:20.034960 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:20.034942    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:20.645982 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:20.645941    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" event={"ID":"19c1be0a-e32a-404a-b5d0-332e45279743","Type":"ContainerStarted","Data":"8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3"}
Jul 28 01:35:20.646438 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:20.645992    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" event={"ID":"19c1be0a-e32a-404a-b5d0-332e45279743","Type":"ContainerStarted","Data":"6210d9daf9c61ca58caf9f1b826ad75e0036bf7a48616db0916de9ee077b3214"}
Jul 28 01:35:20.666575 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:20.666523    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" podStartSLOduration=1.666506633 podStartE2EDuration="1.666506633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:35:20.665010822 +0000 UTC m=+1853.279318894" watchObservedRunningTime="2026-07-28 01:35:20.666506633 +0000 UTC m=+1853.280814706"
Jul 28 01:35:20.876725 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:20.876692    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:21.403123 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:21.403082    2552 patch_prober.go:28] interesting pod/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 01:35:21.403407 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:21.403162    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:35:21.882265 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:21.882188    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:22.103702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:22.103669    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:22.203543 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:22.203508    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:22.301677 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:22.301643    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:22.509170 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:22.509061    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:22.657734 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:22.657704    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:22.658776 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:22.658757    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:22.871679 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:22.871588    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:22.973541 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:22.973499    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:24.067659 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.067587    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:35:24.233637 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.233607    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-certs\") pod \"479b3255-0e59-4670-999a-77c2d7357107\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") "
Jul 28 01:35:24.233849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.233674    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-envoy\") pod \"479b3255-0e59-4670-999a-77c2d7357107\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") "
Jul 28 01:35:24.233849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.233722    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-socket\") pod \"479b3255-0e59-4670-999a-77c2d7357107\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") "
Jul 28 01:35:24.233849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.233755    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/479b3255-0e59-4670-999a-77c2d7357107-istiod-ca-cert\") pod \"479b3255-0e59-4670-999a-77c2d7357107\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") "
Jul 28 01:35:24.233849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.233784    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/479b3255-0e59-4670-999a-77c2d7357107-istio-podinfo\") pod \"479b3255-0e59-4670-999a-77c2d7357107\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") "
Jul 28 01:35:24.233849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.233817    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-istio-token\") pod \"479b3255-0e59-4670-999a-77c2d7357107\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") "
Jul 28 01:35:24.234098 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.233865    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-credential-socket\") pod \"479b3255-0e59-4670-999a-77c2d7357107\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") "
Jul 28 01:35:24.234098 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.233931    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-data\") pod \"479b3255-0e59-4670-999a-77c2d7357107\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") "
Jul 28 01:35:24.234098 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.233967    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmkp8\" (UniqueName: \"kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-kube-api-access-zmkp8\") pod \"479b3255-0e59-4670-999a-77c2d7357107\" (UID: \"479b3255-0e59-4670-999a-77c2d7357107\") "
Jul 28 01:35:24.234098 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.233983    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "479b3255-0e59-4670-999a-77c2d7357107" (UID: "479b3255-0e59-4670-999a-77c2d7357107"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:24.234417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.234271    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "479b3255-0e59-4670-999a-77c2d7357107" (UID: "479b3255-0e59-4670-999a-77c2d7357107"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:24.234417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.234297    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:24.234549 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.234443    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "479b3255-0e59-4670-999a-77c2d7357107" (UID: "479b3255-0e59-4670-999a-77c2d7357107"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:24.234714 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.234687    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/479b3255-0e59-4670-999a-77c2d7357107-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "479b3255-0e59-4670-999a-77c2d7357107" (UID: "479b3255-0e59-4670-999a-77c2d7357107"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:35:24.234981 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.234960    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-data" (OuterVolumeSpecName: "istio-data") pod "479b3255-0e59-4670-999a-77c2d7357107" (UID: "479b3255-0e59-4670-999a-77c2d7357107"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:24.236317 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.236289    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-istio-token" (OuterVolumeSpecName: "istio-token") pod "479b3255-0e59-4670-999a-77c2d7357107" (UID: "479b3255-0e59-4670-999a-77c2d7357107"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:35:24.236545 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.236518    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/479b3255-0e59-4670-999a-77c2d7357107-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "479b3255-0e59-4670-999a-77c2d7357107" (UID: "479b3255-0e59-4670-999a-77c2d7357107"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:35:24.236719 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.236700    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "479b3255-0e59-4670-999a-77c2d7357107" (UID: "479b3255-0e59-4670-999a-77c2d7357107"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:24.236768 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.236700    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-kube-api-access-zmkp8" (OuterVolumeSpecName: "kube-api-access-zmkp8") pod "479b3255-0e59-4670-999a-77c2d7357107" (UID: "479b3255-0e59-4670-999a-77c2d7357107"). InnerVolumeSpecName "kube-api-access-zmkp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:35:24.335309 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.335219    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/479b3255-0e59-4670-999a-77c2d7357107-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:24.335309 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.335248    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/479b3255-0e59-4670-999a-77c2d7357107-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:24.335309 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.335256    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:24.335309 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.335266    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:24.335309 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.335275    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:24.335309 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.335285    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmkp8\" (UniqueName: \"kubernetes.io/projected/479b3255-0e59-4670-999a-77c2d7357107-kube-api-access-zmkp8\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:24.335309 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.335293    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:24.335309 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.335301    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/479b3255-0e59-4670-999a-77c2d7357107-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:24.671531 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.671493    2552 generic.go:356] "Generic (PLEG): container finished" podID="479b3255-0e59-4670-999a-77c2d7357107" containerID="d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5" exitCode=0
Jul 28 01:35:24.671737 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.671554    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"
Jul 28 01:35:24.671737 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.671586    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" event={"ID":"479b3255-0e59-4670-999a-77c2d7357107","Type":"ContainerDied","Data":"d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5"}
Jul 28 01:35:24.671737 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.671670    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc" event={"ID":"479b3255-0e59-4670-999a-77c2d7357107","Type":"ContainerDied","Data":"c796f49e0853f81312e74d08e1409d261957866725aeaddad6e2be8961509c34"}
Jul 28 01:35:24.671737 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.671709    2552 scope.go:117] "RemoveContainer" containerID="d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5"
Jul 28 01:35:24.682047 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.682024    2552 scope.go:117] "RemoveContainer" containerID="ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152"
Jul 28 01:35:24.691482 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.691449    2552 scope.go:117] "RemoveContainer" containerID="d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5"
Jul 28 01:35:24.691796 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:35:24.691776    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5\": container with ID starting with d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5 not found: ID does not exist" containerID="d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5"
Jul 28 01:35:24.691847 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.691807    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5"} err="failed to get container status \"d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5\": rpc error: code = NotFound desc = could not find container \"d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5\": container with ID starting with d50599bd033454e67990c53101b5937a75e3a28455a8139646c299585e70e7b5 not found: ID does not exist"
Jul 28 01:35:24.691847 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.691825    2552 scope.go:117] "RemoveContainer" containerID="ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152"
Jul 28 01:35:24.692086 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:35:24.692064    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152\": container with ID starting with ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152 not found: ID does not exist" containerID="ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152"
Jul 28 01:35:24.692168 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.692096    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152"} err="failed to get container status \"ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152\": rpc error: code = NotFound desc = could not find container \"ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152\": container with ID starting with ca8e70365bdd8a7c56d0c54e233a73a410d5284d5a3d31e6567600e9696d1152 not found: ID does not exist"
Jul 28 01:35:24.697484 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.697417    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"]
Jul 28 01:35:24.699915 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:24.699895    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b70cb0d5-gw-openshift-default-7c5cb5668d-2kcbc"]
Jul 28 01:35:26.022414 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:26.022387    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="479b3255-0e59-4670-999a-77c2d7357107" path="/var/lib/kubelet/pods/479b3255-0e59-4670-999a-77c2d7357107/volumes"
Jul 28 01:35:36.743911 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:36.743879    2552 generic.go:356] "Generic (PLEG): container finished" podID="19c1be0a-e32a-404a-b5d0-332e45279743" containerID="8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3" exitCode=0
Jul 28 01:35:36.744372 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:36.743941    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" event={"ID":"19c1be0a-e32a-404a-b5d0-332e45279743","Type":"ContainerDied","Data":"8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3"}
Jul 28 01:35:36.744372 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:36.744323    2552 scope.go:117] "RemoveContainer" containerID="8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3"
Jul 28 01:35:36.745271 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:36.745244    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:36.745339 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:36.745313    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:36.745381 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:36.745344    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:37.658085 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:37.658042    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:37.751982 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:37.751945    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" event={"ID":"19c1be0a-e32a-404a-b5d0-332e45279743","Type":"ContainerStarted","Data":"deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647"}
Jul 28 01:35:37.877279 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:37.877237    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:37.878901 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:37.878870    2552 patch_prober.go:28] interesting pod/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 28 01:35:37.879114 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:37.879085    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 28 01:35:38.877587 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:38.877535    2552 patch_prober.go:28] interesting pod/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 28 01:35:38.878147 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:38.877625    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 28 01:35:39.877272 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:39.877228    2552 patch_prober.go:28] interesting pod/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 28 01:35:39.877493 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:39.877305    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 28 01:35:40.877407 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:40.877366    2552 patch_prober.go:28] interesting pod/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Jul 28 01:35:40.878005 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:40.877970    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Jul 28 01:35:41.881077 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:41.881048    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:41.881497 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:41.881479    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:41.882088 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:41.882069    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:52.855699 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:52.855609    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:52.924019 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:52.923980    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:52.986233 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:52.986185    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:53.053166 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:53.053109    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:54.175107 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.175073    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"]
Jul 28 01:35:54.175616 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.175358    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy" containerID="cri-o://deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647" gracePeriod=30
Jul 28 01:35:54.189861 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.189824    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:54.431026 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.430933    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:54.648384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.648343    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:54.963190 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.963148    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"]
Jul 28 01:35:54.963591 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.963570    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy"
Jul 28 01:35:54.963591 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.963585    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy"
Jul 28 01:35:54.963591 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.963596    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy"
Jul 28 01:35:54.963769 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.963602    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy"
Jul 28 01:35:54.963769 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.963674    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy"
Jul 28 01:35:54.963769 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.963681    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="479b3255-0e59-4670-999a-77c2d7357107" containerName="istio-proxy"
Jul 28 01:35:54.963769 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.963692    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="43ef31f7-207f-40b5-af3a-482a0bb77513" containerName="istio-proxy"
Jul 28 01:35:54.966148 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.966117    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:54.969049 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.969021    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-30dd5a44-openshift-default-dockercfg-6ffp7\""
Jul 28 01:35:54.977404 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.977377    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:54.988912 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:54.988886    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"]
Jul 28 01:35:55.018745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.018695    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-certs\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.018745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.018749    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-credential-socket\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.018965 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.018854    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-socket\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.018965 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.018900    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istiod-ca-cert\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.019040 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.018972    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-token\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.019040 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.019029    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-data\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.019106 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.019058    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r25r8\" (UniqueName: \"kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-kube-api-access-r25r8\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.019106 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.019094    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-podinfo\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.019250 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.019232    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-envoy\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.119975 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.119943    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-envoy\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.119983    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-certs\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120006    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-credential-socket\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120040    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-socket\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120064    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istiod-ca-cert\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120087    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-token\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120115    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-data\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120171    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r25r8\" (UniqueName: \"kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-kube-api-access-r25r8\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120564 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120200    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-podinfo\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120564 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120416    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-certs\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120564 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120540    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-socket\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120680 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120621    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-credential-socket\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.120836 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.120817    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-data\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.121124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.121103    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istiod-ca-cert\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.122686 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.122659    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-envoy\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.122888 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.122870    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-podinfo\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.130291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.130270    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:55.134640 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.134610    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r25r8\" (UniqueName: \"kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-kube-api-access-r25r8\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.134823 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.134807    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-token\") pod \"e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") " pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.276712 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.276610    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:55.422936 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.422907    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"]
Jul 28 01:35:55.425085 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:35:55.425063    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbafaaf_19e8_4f54_b7d8_a1778573e9b7.slice/crio-3d126946f47412020e2a0db5ba7323d162f45a862133ef0ecb14ee4e6b6166e1 WatchSource:0}: Error finding container 3d126946f47412020e2a0db5ba7323d162f45a862133ef0ecb14ee4e6b6166e1: Status 404 returned error can't find the container with id 3d126946f47412020e2a0db5ba7323d162f45a862133ef0ecb14ee4e6b6166e1
Jul 28 01:35:55.427294 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.427262    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:55.427357 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.427330    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:55.427394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.427358    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:35:55.862822 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.862783    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" event={"ID":"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7","Type":"ContainerStarted","Data":"20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d"}
Jul 28 01:35:55.863032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.862849    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" event={"ID":"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7","Type":"ContainerStarted","Data":"3d126946f47412020e2a0db5ba7323d162f45a862133ef0ecb14ee4e6b6166e1"}
Jul 28 01:35:55.887081 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:55.887018    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" podStartSLOduration=1.886999795 podStartE2EDuration="1.886999795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:35:55.883931801 +0000 UTC m=+1888.498239873" watchObservedRunningTime="2026-07-28 01:35:55.886999795 +0000 UTC m=+1888.501307980"
Jul 28 01:35:56.277188 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:56.277126    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:56.282325 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:56.282296    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:56.868638 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:56.868602    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:56.869699 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:56.869679    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:35:56.884535 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:56.884501    2552 patch_prober.go:28] interesting pod/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 01:35:56.884692 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:56.884558    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:35:57.237753 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:57.237704    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:57.322315 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:57.322279    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:57.403199 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:57.403162    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:57.512667 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:57.512585    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:58.037023 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:58.036986    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:58.133691 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:58.133661    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:35:59.439980 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.439916    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:59.568424 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568392    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-data\") pod \"19c1be0a-e32a-404a-b5d0-332e45279743\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") "
Jul 28 01:35:59.568424 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568424    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j2kf\" (UniqueName: \"kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-kube-api-access-4j2kf\") pod \"19c1be0a-e32a-404a-b5d0-332e45279743\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") "
Jul 28 01:35:59.568662 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568472    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-credential-socket\") pod \"19c1be0a-e32a-404a-b5d0-332e45279743\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") "
Jul 28 01:35:59.568662 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568494    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-certs\") pod \"19c1be0a-e32a-404a-b5d0-332e45279743\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") "
Jul 28 01:35:59.568662 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568536    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-istio-token\") pod \"19c1be0a-e32a-404a-b5d0-332e45279743\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") "
Jul 28 01:35:59.568662 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568576    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-socket\") pod \"19c1be0a-e32a-404a-b5d0-332e45279743\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") "
Jul 28 01:35:59.568662 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568617    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c1be0a-e32a-404a-b5d0-332e45279743-istio-podinfo\") pod \"19c1be0a-e32a-404a-b5d0-332e45279743\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") "
Jul 28 01:35:59.568914 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568678    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c1be0a-e32a-404a-b5d0-332e45279743-istiod-ca-cert\") pod \"19c1be0a-e32a-404a-b5d0-332e45279743\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") "
Jul 28 01:35:59.568914 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568708    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-envoy\") pod \"19c1be0a-e32a-404a-b5d0-332e45279743\" (UID: \"19c1be0a-e32a-404a-b5d0-332e45279743\") "
Jul 28 01:35:59.568914 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568744    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "19c1be0a-e32a-404a-b5d0-332e45279743" (UID: "19c1be0a-e32a-404a-b5d0-332e45279743"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:59.568914 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568819    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "19c1be0a-e32a-404a-b5d0-332e45279743" (UID: "19c1be0a-e32a-404a-b5d0-332e45279743"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:59.569175 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.568999    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "19c1be0a-e32a-404a-b5d0-332e45279743" (UID: "19c1be0a-e32a-404a-b5d0-332e45279743"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:59.569175 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.569065    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:59.569175 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.569084    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-data" (OuterVolumeSpecName: "istio-data") pod "19c1be0a-e32a-404a-b5d0-332e45279743" (UID: "19c1be0a-e32a-404a-b5d0-332e45279743"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:59.569175 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.569106    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:59.569393 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.569346    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c1be0a-e32a-404a-b5d0-332e45279743-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "19c1be0a-e32a-404a-b5d0-332e45279743" (UID: "19c1be0a-e32a-404a-b5d0-332e45279743"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:35:59.571248 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.571210    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "19c1be0a-e32a-404a-b5d0-332e45279743" (UID: "19c1be0a-e32a-404a-b5d0-332e45279743"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:35:59.571363 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.571335    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-istio-token" (OuterVolumeSpecName: "istio-token") pod "19c1be0a-e32a-404a-b5d0-332e45279743" (UID: "19c1be0a-e32a-404a-b5d0-332e45279743"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:35:59.571489 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.571473    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-kube-api-access-4j2kf" (OuterVolumeSpecName: "kube-api-access-4j2kf") pod "19c1be0a-e32a-404a-b5d0-332e45279743" (UID: "19c1be0a-e32a-404a-b5d0-332e45279743"). InnerVolumeSpecName "kube-api-access-4j2kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:35:59.571558 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.571538    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/19c1be0a-e32a-404a-b5d0-332e45279743-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "19c1be0a-e32a-404a-b5d0-332e45279743" (UID: "19c1be0a-e32a-404a-b5d0-332e45279743"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:35:59.670325 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.670296    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:59.670325 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.670321    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:59.670325 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.670331    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19c1be0a-e32a-404a-b5d0-332e45279743-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:59.670562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.670339    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19c1be0a-e32a-404a-b5d0-332e45279743-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:59.670562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.670348    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:59.670562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.670355    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19c1be0a-e32a-404a-b5d0-332e45279743-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:59.670562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.670362    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j2kf\" (UniqueName: \"kubernetes.io/projected/19c1be0a-e32a-404a-b5d0-332e45279743-kube-api-access-4j2kf\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:35:59.887650 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.887616    2552 generic.go:356] "Generic (PLEG): container finished" podID="19c1be0a-e32a-404a-b5d0-332e45279743" containerID="deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647" exitCode=0
Jul 28 01:35:59.887860 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.887672    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"
Jul 28 01:35:59.887860 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.887704    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" event={"ID":"19c1be0a-e32a-404a-b5d0-332e45279743","Type":"ContainerDied","Data":"deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647"}
Jul 28 01:35:59.887860 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.887774    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw" event={"ID":"19c1be0a-e32a-404a-b5d0-332e45279743","Type":"ContainerDied","Data":"6210d9daf9c61ca58caf9f1b826ad75e0036bf7a48616db0916de9ee077b3214"}
Jul 28 01:35:59.887860 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.887805    2552 scope.go:117] "RemoveContainer" containerID="deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647"
Jul 28 01:35:59.898271 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.898250    2552 scope.go:117] "RemoveContainer" containerID="8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3"
Jul 28 01:35:59.906979 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.906957    2552 scope.go:117] "RemoveContainer" containerID="deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647"
Jul 28 01:35:59.907452 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:35:59.907299    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647\": container with ID starting with deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647 not found: ID does not exist" containerID="deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647"
Jul 28 01:35:59.907452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.907337    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647"} err="failed to get container status \"deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647\": rpc error: code = NotFound desc = could not find container \"deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647\": container with ID starting with deafe7c71442994be527d35c5336bc7bed4d6a19ea4eeb73542e0b99f7b4d647 not found: ID does not exist"
Jul 28 01:35:59.907452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.907358    2552 scope.go:117] "RemoveContainer" containerID="8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3"
Jul 28 01:35:59.907749 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:35:59.907724    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3\": container with ID starting with 8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3 not found: ID does not exist" containerID="8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3"
Jul 28 01:35:59.907808 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.907759    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3"} err="failed to get container status \"8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3\": rpc error: code = NotFound desc = could not find container \"8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3\": container with ID starting with 8beeee8fc7d070a75d3d925e54649fc33afc4fb1de41bc9ec83e402ce6145fc3 not found: ID does not exist"
Jul 28 01:35:59.910710 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.910691    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"]
Jul 28 01:35:59.914052 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:35:59.914031    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0fcf74cb-openshift-default-9c6b696c8-mb6pw"]
Jul 28 01:36:00.022055 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:00.022019    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" path="/var/lib/kubelet/pods/19c1be0a-e32a-404a-b5d0-332e45279743/volumes"
Jul 28 01:36:10.953048 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:10.953013    2552 generic.go:356] "Generic (PLEG): container finished" podID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerID="20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d" exitCode=0
Jul 28 01:36:10.953493 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:10.953071    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" event={"ID":"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7","Type":"ContainerDied","Data":"20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d"}
Jul 28 01:36:10.953542 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:10.953522    2552 scope.go:117] "RemoveContainer" containerID="20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d"
Jul 28 01:36:10.954590 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:10.954558    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:36:10.954665 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:10.954647    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:36:10.954709 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:10.954688    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:36:11.869470 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:11.869438    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:36:11.961804 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:11.961771    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" event={"ID":"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7","Type":"ContainerStarted","Data":"2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd"}
Jul 28 01:36:12.277597 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:12.277547    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:36:12.278982 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:12.278948    2552 patch_prober.go:28] interesting pod/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 28 01:36:12.279154 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:12.279029    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 28 01:36:13.277928 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:13.277881    2552 patch_prober.go:28] interesting pod/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 28 01:36:13.278485 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:13.277956    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 28 01:36:14.277903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:14.277852    2552 patch_prober.go:28] interesting pod/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 28 01:36:14.278161 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:14.277946    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 28 01:36:15.277501 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:15.277447    2552 patch_prober.go:28] interesting pod/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 28 01:36:15.277726 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:15.277539    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 28 01:36:16.281255 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:16.281224    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:36:16.281719 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:16.281625    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:36:16.282224 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:16.282208    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:36:27.890640 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:27.890593    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:27.957713 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:27.957682    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:28.020452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:28.020415    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:28.083871 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:28.083831    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:28.203782 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:28.203687    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"]
Jul 28 01:36:28.203958 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:28.203936    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy" containerID="cri-o://2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd" gracePeriod=30
Jul 28 01:36:28.234612 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:28.234574    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:28.452879 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:28.452840    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:29.070552 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:29.070515    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:29.202940 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:29.202902    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:30.618358 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:30.618321    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:31.284505 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:31.284466    2552 patch_prober.go:28] interesting pod/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 01:36:31.284672 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:31.284541    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:36:32.830406 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:32.830371    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:33.469042 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.468977    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:36:33.592307 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592274    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-envoy\") pod \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") "
Jul 28 01:36:33.592307 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592314    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-credential-socket\") pod \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") "
Jul 28 01:36:33.592556 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592409    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-token\") pod \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") "
Jul 28 01:36:33.592556 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592479    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-data\") pod \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") "
Jul 28 01:36:33.592556 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592507    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-socket\") pod \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") "
Jul 28 01:36:33.592556 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592529    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r25r8\" (UniqueName: \"kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-kube-api-access-r25r8\") pod \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") "
Jul 28 01:36:33.592776 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592584    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istiod-ca-cert\") pod \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") "
Jul 28 01:36:33.592776 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592615    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-podinfo\") pod \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") "
Jul 28 01:36:33.592776 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592641    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-certs\") pod \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\" (UID: \"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7\") "
Jul 28 01:36:33.592776 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592729    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" (UID: "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:36:33.593005 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.592993    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:36:33.593088 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.593056    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" (UID: "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:36:33.593178 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.593115    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" (UID: "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:36:33.593416 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.593390    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" (UID: "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:36:33.593662 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.593397    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" (UID: "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:36:33.594874 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.594848    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" (UID: "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:36:33.595116 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.595094    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-kube-api-access-r25r8" (OuterVolumeSpecName: "kube-api-access-r25r8") pod "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" (UID: "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7"). InnerVolumeSpecName "kube-api-access-r25r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:36:33.595348 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.595324    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" (UID: "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:36:33.595417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.595400    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" (UID: "ecbafaaf-19e8-4f54-b7d8-a1778573e9b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:36:33.693871 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.693835    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:36:33.693871 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.693865    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:36:33.693871 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.693873    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:36:33.693871 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.693883    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:36:33.694172 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.693890    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:36:33.694172 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.693897    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:36:33.694172 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.693905    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:36:33.694172 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:33.693912    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r25r8\" (UniqueName: \"kubernetes.io/projected/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7-kube-api-access-r25r8\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:36:34.103503 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.103461    2552 generic.go:356] "Generic (PLEG): container finished" podID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerID="2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd" exitCode=0
Jul 28 01:36:34.103982 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.103512    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"
Jul 28 01:36:34.103982 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.103521    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" event={"ID":"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7","Type":"ContainerDied","Data":"2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd"}
Jul 28 01:36:34.103982 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.103575    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt" event={"ID":"ecbafaaf-19e8-4f54-b7d8-a1778573e9b7","Type":"ContainerDied","Data":"3d126946f47412020e2a0db5ba7323d162f45a862133ef0ecb14ee4e6b6166e1"}
Jul 28 01:36:34.103982 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.103598    2552 scope.go:117] "RemoveContainer" containerID="2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd"
Jul 28 01:36:34.113206 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.113185    2552 scope.go:117] "RemoveContainer" containerID="20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d"
Jul 28 01:36:34.121031 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.121005    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"]
Jul 28 01:36:34.121718 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.121703    2552 scope.go:117] "RemoveContainer" containerID="2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd"
Jul 28 01:36:34.122028 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:36:34.122008    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd\": container with ID starting with 2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd not found: ID does not exist" containerID="2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd"
Jul 28 01:36:34.122073 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.122038    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd"} err="failed to get container status \"2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd\": rpc error: code = NotFound desc = could not find container \"2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd\": container with ID starting with 2b24ca16305e0c290c5f524510de048da0aec8d8ff4ef3a3d5c16e909e8931cd not found: ID does not exist"
Jul 28 01:36:34.122073 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.122057    2552 scope.go:117] "RemoveContainer" containerID="20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d"
Jul 28 01:36:34.122403 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:36:34.122350    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d\": container with ID starting with 20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d not found: ID does not exist" containerID="20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d"
Jul 28 01:36:34.122403 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.122392    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d"} err="failed to get container status \"20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d\": rpc error: code = NotFound desc = could not find container \"20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d\": container with ID starting with 20da255e0ec55d0561acda1f1012b60572b4c61dab582910ac1653d4a1410f5d not found: ID does not exist"
Jul 28 01:36:34.125223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:34.125202    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-30dd5a44-openshift-default-6569d5d9d8-7dcnt"]
Jul 28 01:36:36.023834 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:36.023792    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" path="/var/lib/kubelet/pods/ecbafaaf-19e8-4f54-b7d8-a1778573e9b7/volumes"
Jul 28 01:36:37.058827 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:37.058789    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:37.161504 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:37.161463    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:37.262916 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:37.262860    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:37.359214 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:37.359096    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:36:42.938052 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:36:42.938021    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:08.937679 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:08.937630    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:15.207703 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:15.207670    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:16.268570 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:16.268530    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:31.359394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:31.359331    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:37.174150 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:37.174103    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:37.239504 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:37.239463    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:37.325898 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:37.325868    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:37.415366 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:37.415322    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:47.915236 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:47.915195    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:48.725319 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:48.725285    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:55.347100 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:55.347055    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:55.455648 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:55.455566    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:55.546758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:55.546728    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:55.647186 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:55.647156    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:37:58.849729 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:37:58.849697    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:07.198710 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:07.198671    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:07.298345 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:07.298303    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:07.398687 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:07.398646    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:09.177498 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:09.177454    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:14.817390 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:14.817323    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:14.921860 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:14.921817    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:15.508254 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:15.508216    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:21.673722 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:21.673669    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:21.775159 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:21.775098    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:21.914701 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:21.914665    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:22.213822 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.213790    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"]
Jul 28 01:38:22.214339 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214316    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy"
Jul 28 01:38:22.214339 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214337    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy"
Jul 28 01:38:22.214499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214348    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy"
Jul 28 01:38:22.214499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214355    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy"
Jul 28 01:38:22.214499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214371    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy"
Jul 28 01:38:22.214499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214376    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy"
Jul 28 01:38:22.214499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214382    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy"
Jul 28 01:38:22.214499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214387    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy"
Jul 28 01:38:22.214499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214456    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy"
Jul 28 01:38:22.214499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214464    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy"
Jul 28 01:38:22.214499 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.214474    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbafaaf-19e8-4f54-b7d8-a1778573e9b7" containerName="istio-proxy"
Jul 28 01:38:22.217779 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.217760    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.220482 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.220459    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6046872f-openshift-default-dockercfg-79m4g\""
Jul 28 01:38:22.237301 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.237270    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"]
Jul 28 01:38:22.244965 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.244924    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:22.326931 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.326897    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-certs\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.327142 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.326941    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwdvs\" (UniqueName: \"kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-kube-api-access-bwdvs\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.327142 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.326966    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-envoy\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.327142 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.327030    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-podinfo\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.327142 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.327093    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-socket\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.327142 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.327114    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-token\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.327414 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.327221    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-credential-socket\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.327414 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.327257    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istiod-ca-cert\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.327414 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.327290    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-data\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.428606 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.428570    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-socket\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.428806 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.428614    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-token\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.428806 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.428667    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-credential-socket\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.428806 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.428685    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istiod-ca-cert\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.428806 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.428707    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-data\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.428806 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.428770    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-certs\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.429111 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.428808    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwdvs\" (UniqueName: \"kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-kube-api-access-bwdvs\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.429111 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.428837    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-envoy\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.429111 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.428873    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-podinfo\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.429111 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.429071    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-socket\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.429290 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.429234    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-certs\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.429518 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.429481    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istiod-ca-cert\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.429638 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.429609    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-credential-socket\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.429702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.429679    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-data\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.431924 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.431907    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-envoy\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.432148 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.432115    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-podinfo\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.436921 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.436898    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-token\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.437214 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.437193    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwdvs\" (UniqueName: \"kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-kube-api-access-bwdvs\") pod \"e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") " pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.528195 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.528081    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:22.690702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.690672    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"]
Jul 28 01:38:22.698520 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:38:22.698478    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a4484d_fbc1_4ae3_9a71_055c624c8cf9.slice/crio-82385abd039307a7fc134085b8e17382a3fc258740c919ffc0420c0f6abd4d58 WatchSource:0}: Error finding container 82385abd039307a7fc134085b8e17382a3fc258740c919ffc0420c0f6abd4d58: Status 404 returned error can't find the container with id 82385abd039307a7fc134085b8e17382a3fc258740c919ffc0420c0f6abd4d58
Jul 28 01:38:22.700552 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.700402    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:38:22.700675 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.700580    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:38:22.700754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.700721    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:38:22.724110 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.724067    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" event={"ID":"18a4484d-fbc1-4ae3-9a71-055c624c8cf9","Type":"ContainerStarted","Data":"82385abd039307a7fc134085b8e17382a3fc258740c919ffc0420c0f6abd4d58"}
Jul 28 01:38:22.865685 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:22.865607    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:23.730951 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:23.730917    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" event={"ID":"18a4484d-fbc1-4ae3-9a71-055c624c8cf9","Type":"ContainerStarted","Data":"5fae925446f25aeae2c3fda8090554e668b1daeae1bbb957df2001231c202932"}
Jul 28 01:38:23.755200 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:23.755125    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" podStartSLOduration=1.7551113649999999 podStartE2EDuration="1.755111365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:38:23.752009629 +0000 UTC m=+2036.366317702" watchObservedRunningTime="2026-07-28 01:38:23.755111365 +0000 UTC m=+2036.369419437"
Jul 28 01:38:24.529043 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:24.529010    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:24.534377 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:24.534350    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:24.737493 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:24.737455    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:24.738425 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:24.738405    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:25.795257 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:25.795219    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:25.896383 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:25.896352    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:26.053440 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:26.053190    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:26.192567 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:26.192529    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:26.790698 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:26.790660    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:26.886417 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:26.886384    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:38.825671 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:38.825637    2552 generic.go:356] "Generic (PLEG): container finished" podID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerID="5fae925446f25aeae2c3fda8090554e668b1daeae1bbb957df2001231c202932" exitCode=0
Jul 28 01:38:38.826250 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:38.825716    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" event={"ID":"18a4484d-fbc1-4ae3-9a71-055c624c8cf9","Type":"ContainerDied","Data":"5fae925446f25aeae2c3fda8090554e668b1daeae1bbb957df2001231c202932"}
Jul 28 01:38:38.826335 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:38.826249    2552 scope.go:117] "RemoveContainer" containerID="5fae925446f25aeae2c3fda8090554e668b1daeae1bbb957df2001231c202932"
Jul 28 01:38:38.827322 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:38.827290    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:38:38.827392 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:38.827363    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:38:38.827430 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:38.827403    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:38:39.737521 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:39.737475    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:39.833609 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:39.833574    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" event={"ID":"18a4484d-fbc1-4ae3-9a71-055c624c8cf9","Type":"ContainerStarted","Data":"ca86ed4d6eee8f83cc347d28b48d3612d4b57c382e44274dffc0a9beffc17239"}
Jul 28 01:38:40.528255 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:40.528214    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:40.529562 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:40.529537    2552 patch_prober.go:28] interesting pod/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 28 01:38:40.529668 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:40.529586    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 28 01:38:41.529002 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:41.528960    2552 patch_prober.go:28] interesting pod/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 28 01:38:41.529437 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:41.529026    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 28 01:38:42.529431 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:42.529396    2552 patch_prober.go:28] interesting pod/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 28 01:38:42.529850 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:42.529452    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 28 01:38:43.528556 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:43.528519    2552 patch_prober.go:28] interesting pod/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 28 01:38:43.528730 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:43.528570    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 28 01:38:44.532692 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:44.532663    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:44.533080 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:44.532932    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:44.533836 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:44.533820    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:38:50.781779 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:50.781695    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:51.475008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:51.474973    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:51.573084 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:51.573053    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:51.909390 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:51.909347    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:54.640078 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:54.640037    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:54.702661 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:54.702628    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:57.593055 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:57.593012    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:38:57.693604 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:38:57.693570    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:08.424083 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:08.424025    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:08.489789 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:08.489708    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:08.551847 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:08.551807    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:08.626255 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:08.626220    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:08.971679 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:08.971624    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:14.645027 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:14.644980    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:14.719277 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:14.719239    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:14.923676 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:14.923588    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"]
Jul 28 01:39:14.923867 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:14.923840    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy" containerID="cri-o://ca86ed4d6eee8f83cc347d28b48d3612d4b57c382e44274dffc0a9beffc17239" gracePeriod=30
Jul 28 01:39:14.938980 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:14.938949    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:15.230296 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:15.230207    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:15.384725 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:15.384686    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:15.595443 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:15.595347    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:15.685211 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:15.685181    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:20.074080 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.074033    2552 generic.go:356] "Generic (PLEG): container finished" podID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerID="ca86ed4d6eee8f83cc347d28b48d3612d4b57c382e44274dffc0a9beffc17239" exitCode=0
Jul 28 01:39:20.074522 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.074083    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" event={"ID":"18a4484d-fbc1-4ae3-9a71-055c624c8cf9","Type":"ContainerDied","Data":"ca86ed4d6eee8f83cc347d28b48d3612d4b57c382e44274dffc0a9beffc17239"}
Jul 28 01:39:20.074522 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.074163    2552 scope.go:117] "RemoveContainer" containerID="5fae925446f25aeae2c3fda8090554e668b1daeae1bbb957df2001231c202932"
Jul 28 01:39:20.176633 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.176608    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:39:20.274354 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274262    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-credential-socket\") pod \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") "
Jul 28 01:39:20.274511 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274373    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-envoy\") pod \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") "
Jul 28 01:39:20.274511 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274399    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-podinfo\") pod \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") "
Jul 28 01:39:20.274511 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274419    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-token\") pod \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") "
Jul 28 01:39:20.274511 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274446    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istiod-ca-cert\") pod \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") "
Jul 28 01:39:20.274511 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274481    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-data\") pod \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") "
Jul 28 01:39:20.274762 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274540    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwdvs\" (UniqueName: \"kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-kube-api-access-bwdvs\") pod \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") "
Jul 28 01:39:20.274762 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274569    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-certs\") pod \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") "
Jul 28 01:39:20.274762 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274560    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18a4484d-fbc1-4ae3-9a71-055c624c8cf9" (UID: "18a4484d-fbc1-4ae3-9a71-055c624c8cf9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:39:20.274762 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274597    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-socket\") pod \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\" (UID: \"18a4484d-fbc1-4ae3-9a71-055c624c8cf9\") "
Jul 28 01:39:20.274973 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274939    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:39:20.274973 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274952    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18a4484d-fbc1-4ae3-9a71-055c624c8cf9" (UID: "18a4484d-fbc1-4ae3-9a71-055c624c8cf9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:39:20.275065 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.274977    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18a4484d-fbc1-4ae3-9a71-055c624c8cf9" (UID: "18a4484d-fbc1-4ae3-9a71-055c624c8cf9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:39:20.275362 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.275339    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18a4484d-fbc1-4ae3-9a71-055c624c8cf9" (UID: "18a4484d-fbc1-4ae3-9a71-055c624c8cf9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:39:20.275875 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.275850    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-data" (OuterVolumeSpecName: "istio-data") pod "18a4484d-fbc1-4ae3-9a71-055c624c8cf9" (UID: "18a4484d-fbc1-4ae3-9a71-055c624c8cf9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:39:20.276673 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.276641    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18a4484d-fbc1-4ae3-9a71-055c624c8cf9" (UID: "18a4484d-fbc1-4ae3-9a71-055c624c8cf9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:39:20.276784 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.276733    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18a4484d-fbc1-4ae3-9a71-055c624c8cf9" (UID: "18a4484d-fbc1-4ae3-9a71-055c624c8cf9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:39:20.277157 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.277120    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-kube-api-access-bwdvs" (OuterVolumeSpecName: "kube-api-access-bwdvs") pod "18a4484d-fbc1-4ae3-9a71-055c624c8cf9" (UID: "18a4484d-fbc1-4ae3-9a71-055c624c8cf9"). InnerVolumeSpecName "kube-api-access-bwdvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:39:20.277207 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.277151    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-token" (OuterVolumeSpecName: "istio-token") pod "18a4484d-fbc1-4ae3-9a71-055c624c8cf9" (UID: "18a4484d-fbc1-4ae3-9a71-055c624c8cf9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:39:20.376037 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.376000    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:39:20.376037 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.376031    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:39:20.376037 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.376039    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:39:20.376037 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.376047    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:39:20.376340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.376054    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:39:20.376340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.376064    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwdvs\" (UniqueName: \"kubernetes.io/projected/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-kube-api-access-bwdvs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:39:20.376340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.376072    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:39:20.376340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:20.376080    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18a4484d-fbc1-4ae3-9a71-055c624c8cf9-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:39:21.081013 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:21.080976    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"
Jul 28 01:39:21.081013 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:21.080995    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d" event={"ID":"18a4484d-fbc1-4ae3-9a71-055c624c8cf9","Type":"ContainerDied","Data":"82385abd039307a7fc134085b8e17382a3fc258740c919ffc0420c0f6abd4d58"}
Jul 28 01:39:21.081568 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:21.081051    2552 scope.go:117] "RemoveContainer" containerID="ca86ed4d6eee8f83cc347d28b48d3612d4b57c382e44274dffc0a9beffc17239"
Jul 28 01:39:21.102862 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:21.102832    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"]
Jul 28 01:39:21.106359 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:21.106334    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6046872f-openshift-default-5d98d69f76-vpz6d"]
Jul 28 01:39:21.376733 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:21.376622    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:21.449189 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:21.449116    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:21.548974 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:21.548932    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:21.647493 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:21.647451    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:21.750178 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:21.750118    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:22.022585 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:22.022508    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" path="/var/lib/kubelet/pods/18a4484d-fbc1-4ae3-9a71-055c624c8cf9/volumes"
Jul 28 01:39:27.496791 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:27.496754    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:27.597341 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:27.597299    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:34.487350 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.487309    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:34.810162 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.810047    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"]
Jul 28 01:39:34.810493 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.810480    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy"
Jul 28 01:39:34.810539 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.810495    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy"
Jul 28 01:39:34.810598 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.810572    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="19c1be0a-e32a-404a-b5d0-332e45279743" containerName="istio-proxy"
Jul 28 01:39:34.810598 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.810585    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy"
Jul 28 01:39:34.810598 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.810592    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy"
Jul 28 01:39:34.813293 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.813269    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:34.816917 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.816891    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f0341a4c-openshift-default-dockercfg-jfnwq\""
Jul 28 01:39:34.831223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.831187    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"]
Jul 28 01:39:34.851085 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.851051    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:34.912414 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.912373    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-envoy\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:34.912618 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.912416    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t97wn\" (UniqueName: \"kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-kube-api-access-t97wn\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:34.912618 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.912534    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-podinfo\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:34.912618 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.912597    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-token\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:34.912777 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.912635    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-data\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:34.912777 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.912662    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-socket\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:34.912777 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.912742    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-certs\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:34.912903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.912805    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-credential-socket\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:34.912903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:34.912833    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istiod-ca-cert\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014082 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014033    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-credential-socket\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014082 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014087    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istiod-ca-cert\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014116    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-envoy\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014162    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t97wn\" (UniqueName: \"kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-kube-api-access-t97wn\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014184    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-podinfo\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014226    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-token\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014255    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-data\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014283    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-socket\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014331    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-certs\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014704 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014519    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-credential-socket\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014704 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014627    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-data\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014793 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014707    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-certs\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.014793 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.014777    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-socket\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.015038 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.015001    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istiod-ca-cert\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.016616 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.016595    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-envoy\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.016920 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.016902    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-podinfo\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.022726 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.022700    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-token\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.023043 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.022763    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t97wn\" (UniqueName: \"kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-kube-api-access-t97wn\") pod \"e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") " pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.041166 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.041119    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:35.124202 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.124088    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:35.269145 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.269106    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"]
Jul 28 01:39:35.270595 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:39:35.270568    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf419df3_cd2e_4ba9_a85b_d17448d80c2d.slice/crio-41d748f4511d7a2c0746434b4d58ca318b0122df0e9475a29891042890118e6a WatchSource:0}: Error finding container 41d748f4511d7a2c0746434b4d58ca318b0122df0e9475a29891042890118e6a: Status 404 returned error can't find the container with id 41d748f4511d7a2c0746434b4d58ca318b0122df0e9475a29891042890118e6a
Jul 28 01:39:35.272807 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.272762    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:39:35.272883 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.272864    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:39:35.272921 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:35.272908    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:39:36.167875 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:36.167835    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" event={"ID":"cf419df3-cd2e-4ba9-a85b-d17448d80c2d","Type":"ContainerStarted","Data":"6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331"}
Jul 28 01:39:36.168398 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:36.167897    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" event={"ID":"cf419df3-cd2e-4ba9-a85b-d17448d80c2d","Type":"ContainerStarted","Data":"41d748f4511d7a2c0746434b4d58ca318b0122df0e9475a29891042890118e6a"}
Jul 28 01:39:36.189844 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:36.189788    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" podStartSLOduration=2.189771941 podStartE2EDuration="2.189771941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:39:36.187539384 +0000 UTC m=+2108.801847456" watchObservedRunningTime="2026-07-28 01:39:36.189771941 +0000 UTC m=+2108.804080013"
Jul 28 01:39:37.125274 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:37.125239    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:37.130416 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:37.130395    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:37.172750 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:37.172715    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:37.173652 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:37.173635    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:38.124990 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:38.124945    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:38.260636 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:38.260599    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:38.360345 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:38.360310    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:38.927947 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:38.927913    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:39.023538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:39.023503    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:39:52.974063 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:52.973707    2552 patch_prober.go:28] interesting pod/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": read tcp 10.134.0.2:33254->10.134.0.62:15021: read: connection reset by peer" start-of-body=
Jul 28 01:39:52.974063 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:52.973767    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": read tcp 10.134.0.2:33254->10.134.0.62:15021: read: connection reset by peer"
Jul 28 01:39:53.270512 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:53.270423    2552 generic.go:356] "Generic (PLEG): container finished" podID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerID="6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331" exitCode=0
Jul 28 01:39:53.270512 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:53.270490    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" event={"ID":"cf419df3-cd2e-4ba9-a85b-d17448d80c2d","Type":"ContainerDied","Data":"6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331"}
Jul 28 01:39:53.270932 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:53.270909    2552 scope.go:117] "RemoveContainer" containerID="6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331"
Jul 28 01:39:53.271874 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:53.271845    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:39:53.271932 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:53.271911    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:39:53.271969 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:53.271952    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:39:54.283498 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:54.283449    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" event={"ID":"cf419df3-cd2e-4ba9-a85b-d17448d80c2d","Type":"ContainerStarted","Data":"c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f"}
Jul 28 01:39:55.124881 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:55.124840    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:55.125181 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:55.125121    2552 patch_prober.go:28] interesting pod/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 28 01:39:55.125250 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:55.125229    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 28 01:39:56.125234 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:56.125196    2552 patch_prober.go:28] interesting pod/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 28 01:39:56.125636 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:56.125289    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 28 01:39:57.124777 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:57.124741    2552 patch_prober.go:28] interesting pod/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 28 01:39:57.124970 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:57.124829    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 28 01:39:58.124828 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:58.124793    2552 patch_prober.go:28] interesting pod/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 28 01:39:58.125288 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:58.124849    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 28 01:39:59.128590 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:59.128558    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:59.129117 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:59.128953    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:39:59.129793 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:39:59.129777    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:40:03.161438 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:40:03.161396    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:40:08.338770 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:40:08.338735    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:40:48.069791 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:40:48.069748    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:40:48.172583 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:40:48.172545    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:40:48.258591 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:40:48.258555    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:40:48.330869 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:40:48.330780    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:40:51.653879 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:40:51.653842    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:40:56.702075 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:40:56.702038    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:32.847745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:32.847708    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:33.751294 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:33.751259    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:39.285912 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:39.285873    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:39.387570 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:39.387530    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:39.529003 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:39.528957    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"]
Jul 28 01:41:39.529234 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:39.529212    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy" containerID="cri-o://c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f" gracePeriod=30
Jul 28 01:41:39.546744 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:39.546657    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:39.778710 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:39.778674    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:40.834197 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:40.834162    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:40.932988 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:40.932950    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:41.032850 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:41.032818    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:41.842261 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:41.842229    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:41.938696 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:41.938666    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:42.036574 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:42.036537    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:43.477621 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:43.477586    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:44.131479 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.131434    2552 patch_prober.go:28] interesting pod/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 01:41:44.131645 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.131511    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:41:44.820524 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.820498    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:41:44.908193 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.908124    2552 generic.go:356] "Generic (PLEG): container finished" podID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerID="c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f" exitCode=0
Jul 28 01:41:44.908355 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.908197    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"
Jul 28 01:41:44.908355 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.908209    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" event={"ID":"cf419df3-cd2e-4ba9-a85b-d17448d80c2d","Type":"ContainerDied","Data":"c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f"}
Jul 28 01:41:44.908355 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.908288    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97" event={"ID":"cf419df3-cd2e-4ba9-a85b-d17448d80c2d","Type":"ContainerDied","Data":"41d748f4511d7a2c0746434b4d58ca318b0122df0e9475a29891042890118e6a"}
Jul 28 01:41:44.908355 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.908319    2552 scope.go:117] "RemoveContainer" containerID="c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f"
Jul 28 01:41:44.918269 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.918248    2552 scope.go:117] "RemoveContainer" containerID="6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331"
Jul 28 01:41:44.926853 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.926826    2552 scope.go:117] "RemoveContainer" containerID="c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f"
Jul 28 01:41:44.927149 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:41:44.927107    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f\": container with ID starting with c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f not found: ID does not exist" containerID="c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f"
Jul 28 01:41:44.927243 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.927159    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f"} err="failed to get container status \"c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f\": rpc error: code = NotFound desc = could not find container \"c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f\": container with ID starting with c48776c8dd5119feb994a18da7ab5133f918015719056550c327a3ad23bcd13f not found: ID does not exist"
Jul 28 01:41:44.927243 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.927183    2552 scope.go:117] "RemoveContainer" containerID="6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331"
Jul 28 01:41:44.927475 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:41:44.927451    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331\": container with ID starting with 6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331 not found: ID does not exist" containerID="6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331"
Jul 28 01:41:44.927539 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.927485    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331"} err="failed to get container status \"6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331\": rpc error: code = NotFound desc = could not find container \"6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331\": container with ID starting with 6430c63300bdbb00c88f0c16a1c7769f8b604f17da91ed88bd8b26574841b331 not found: ID does not exist"
Jul 28 01:41:44.967237 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.967196    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-data\") pod \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") "
Jul 28 01:41:44.967408 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.967244    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-socket\") pod \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") "
Jul 28 01:41:44.967408 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.967279    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-credential-socket\") pod \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") "
Jul 28 01:41:44.967408 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.967311    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-token\") pod \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") "
Jul 28 01:41:44.967408 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.967382    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t97wn\" (UniqueName: \"kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-kube-api-access-t97wn\") pod \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") "
Jul 28 01:41:44.967637 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.967416    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-envoy\") pod \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") "
Jul 28 01:41:44.967637 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.967447    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-podinfo\") pod \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") "
Jul 28 01:41:44.967637 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.967469    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf419df3-cd2e-4ba9-a85b-d17448d80c2d" (UID: "cf419df3-cd2e-4ba9-a85b-d17448d80c2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:41:44.967781 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.967617    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf419df3-cd2e-4ba9-a85b-d17448d80c2d" (UID: "cf419df3-cd2e-4ba9-a85b-d17448d80c2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:41:44.967934 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.967911    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istiod-ca-cert\") pod \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") "
Jul 28 01:41:44.968246 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.968228    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-certs\") pod \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\" (UID: \"cf419df3-cd2e-4ba9-a85b-d17448d80c2d\") "
Jul 28 01:41:44.968376 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.968350    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf419df3-cd2e-4ba9-a85b-d17448d80c2d" (UID: "cf419df3-cd2e-4ba9-a85b-d17448d80c2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:41:44.968530 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.968502    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf419df3-cd2e-4ba9-a85b-d17448d80c2d" (UID: "cf419df3-cd2e-4ba9-a85b-d17448d80c2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:41:44.968530 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.968428    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf419df3-cd2e-4ba9-a85b-d17448d80c2d" (UID: "cf419df3-cd2e-4ba9-a85b-d17448d80c2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:41:44.968820 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.968791    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:41:44.968820 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.968819    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:41:44.968973 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.968829    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:41:44.968973 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.968838    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:41:44.968973 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.968852    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:41:44.969999 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.969973    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf419df3-cd2e-4ba9-a85b-d17448d80c2d" (UID: "cf419df3-cd2e-4ba9-a85b-d17448d80c2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:41:44.970416 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.970391    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf419df3-cd2e-4ba9-a85b-d17448d80c2d" (UID: "cf419df3-cd2e-4ba9-a85b-d17448d80c2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:41:44.970512 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.970444    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf419df3-cd2e-4ba9-a85b-d17448d80c2d" (UID: "cf419df3-cd2e-4ba9-a85b-d17448d80c2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:41:44.970847 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:44.970822    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-kube-api-access-t97wn" (OuterVolumeSpecName: "kube-api-access-t97wn") pod "cf419df3-cd2e-4ba9-a85b-d17448d80c2d" (UID: "cf419df3-cd2e-4ba9-a85b-d17448d80c2d"). InnerVolumeSpecName "kube-api-access-t97wn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:41:45.070031 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:45.069939    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:41:45.070031 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:45.069975    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:41:45.070031 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:45.069987    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:41:45.070031 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:45.069999    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t97wn\" (UniqueName: \"kubernetes.io/projected/cf419df3-cd2e-4ba9-a85b-d17448d80c2d-kube-api-access-t97wn\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:41:45.233797 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:45.233759    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"]
Jul 28 01:41:45.237489 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:45.237464    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f0341a4c-openshift-default-6dd5f78b9b-qdk97"]
Jul 28 01:41:46.022587 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:46.022556    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" path="/var/lib/kubelet/pods/cf419df3-cd2e-4ba9-a85b-d17448d80c2d/volumes"
Jul 28 01:41:49.121564 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:49.121475    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:49.190512 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:49.190473    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:49.816627 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:49.816588    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:55.435365 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:55.435328    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:55.542148 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:55.542099    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:41:55.639287 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:41:55.639246    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:06.146207 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:06.146170    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:06.485214 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:06.485096    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:07.279115 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:07.279074    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:27.452144 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:27.452101    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:33.928289 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:33.928239    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:34.028025 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.027970    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:34.289837 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.289739    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:34.732965 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.732923    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"]
Jul 28 01:42:34.733364 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.733352    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy"
Jul 28 01:42:34.733421 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.733366    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy"
Jul 28 01:42:34.733421 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.733386    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy"
Jul 28 01:42:34.733421 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.733391    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a4484d-fbc1-4ae3-9a71-055c624c8cf9" containerName="istio-proxy"
Jul 28 01:42:34.733515 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.733463    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy"
Jul 28 01:42:34.733515 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.733471    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy"
Jul 28 01:42:34.736650 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.736632    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.745849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.745829    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-45a9e6-openshift-default-dockercfg-v9bm6\""
Jul 28 01:42:34.759180 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.759142    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:34.762073 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.762042    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"]
Jul 28 01:42:34.839398 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.839358    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-envoy\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.839398 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.839397    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-certs\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.839632 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.839490    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408d0a74-7084-4898-bcb6-bf58beecfa92-istiod-ca-cert\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.839632 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.839522    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-socket\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.839632 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.839540    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-data\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.839632 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.839604    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-podinfo\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.839791 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.839644    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-token\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.839791 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.839696    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqtk6\" (UniqueName: \"kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-kube-api-access-pqtk6\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.839791 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.839729    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-credential-socket\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.917168 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.917112    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:34.941423 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.941386    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-envoy\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.941958 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.941935    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-certs\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.942125 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.942110    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408d0a74-7084-4898-bcb6-bf58beecfa92-istiod-ca-cert\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.942268 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.942253    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-socket\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.942374 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.942360    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-data\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.942494 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.942480    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-podinfo\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.942602 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.942589    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-token\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.942711 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.942696    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqtk6\" (UniqueName: \"kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-kube-api-access-pqtk6\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.942866 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.942852    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-credential-socket\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.943427 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.943407    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-credential-socket\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.947351 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.946315    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-envoy\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.947351 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.946575    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-certs\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.947351 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.947202    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-socket\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.947351 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.947221    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408d0a74-7084-4898-bcb6-bf58beecfa92-istiod-ca-cert\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.947606 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.947393    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-data\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.949832 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.949808    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-podinfo\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.956388 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.956360    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-token\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:34.957500 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:34.957482    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqtk6\" (UniqueName: \"kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-kube-api-access-pqtk6\") pod \"e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") " pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:35.047803 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:35.047711    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:35.187961 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:35.187932    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"]
Jul 28 01:42:35.189163 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:42:35.189112    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408d0a74_7084_4898_bcb6_bf58beecfa92.slice/crio-9038f6b09364ff6dd4f3cbbb608c20f0d72d47ad94964beb098dfc1c6b345604 WatchSource:0}: Error finding container 9038f6b09364ff6dd4f3cbbb608c20f0d72d47ad94964beb098dfc1c6b345604: Status 404 returned error can't find the container with id 9038f6b09364ff6dd4f3cbbb608c20f0d72d47ad94964beb098dfc1c6b345604
Jul 28 01:42:35.191388 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:35.191354    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:42:35.191466 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:35.191419    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:42:35.191466 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:35.191449    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:42:35.202646 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:35.202620    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" event={"ID":"408d0a74-7084-4898-bcb6-bf58beecfa92","Type":"ContainerStarted","Data":"9038f6b09364ff6dd4f3cbbb608c20f0d72d47ad94964beb098dfc1c6b345604"}
Jul 28 01:42:36.210779 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:36.210739    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" event={"ID":"408d0a74-7084-4898-bcb6-bf58beecfa92","Type":"ContainerStarted","Data":"0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d"}
Jul 28 01:42:36.236389 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:36.236342    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" podStartSLOduration=2.236327144 podStartE2EDuration="2.236327144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:42:36.235782414 +0000 UTC m=+2288.850090487" watchObservedRunningTime="2026-07-28 01:42:36.236327144 +0000 UTC m=+2288.850635288"
Jul 28 01:42:37.048361 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:37.048327    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:37.053558 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:37.053534    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:37.216733 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:37.216702    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:37.217840 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:37.217818    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:38.435220 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:38.435179    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:38.530578 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:38.530517    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:39.059283 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:39.059240    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:39.161238 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:39.161195    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:42:51.309319 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:51.309280    2552 generic.go:356] "Generic (PLEG): container finished" podID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerID="0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d" exitCode=0
Jul 28 01:42:51.309772 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:51.309354    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" event={"ID":"408d0a74-7084-4898-bcb6-bf58beecfa92","Type":"ContainerDied","Data":"0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d"}
Jul 28 01:42:51.309772 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:51.309727    2552 scope.go:117] "RemoveContainer" containerID="0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d"
Jul 28 01:42:51.310715 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:51.310684    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:42:51.310776 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:51.310756    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:42:51.310812 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:51.310796    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:42:52.217225 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:52.217186    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:52.317066 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:52.317011    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" event={"ID":"408d0a74-7084-4898-bcb6-bf58beecfa92","Type":"ContainerStarted","Data":"5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672"}
Jul 28 01:42:53.048518 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:53.048475    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:53.049729 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:53.049700    2552 patch_prober.go:28] interesting pod/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 28 01:42:53.049860 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:53.049766    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 28 01:42:54.048459 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:54.048425    2552 patch_prober.go:28] interesting pod/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 28 01:42:54.048854 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:54.048477    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 28 01:42:55.048428 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:55.048393    2552 patch_prober.go:28] interesting pod/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 28 01:42:55.048615 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:55.048451    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 28 01:42:56.048365 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:56.048330    2552 patch_prober.go:28] interesting pod/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Jul 28 01:42:56.048570 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:56.048388    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Jul 28 01:42:57.052481 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:57.052445    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:57.052951 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:57.052849    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:42:57.053805 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:42:57.053787    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:43:03.210384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.210351    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:03.555926 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.555836    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:03.831797 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.831706    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"]
Jul 28 01:43:03.832164 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.832148    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy"
Jul 28 01:43:03.832164 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.832163    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf419df3-cd2e-4ba9-a85b-d17448d80c2d" containerName="istio-proxy"
Jul 28 01:43:03.834702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.834676    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:03.837340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.837323    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a5bff2-openshift-default-dockercfg-h9k92\""
Jul 28 01:43:03.847531 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.847505    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"]
Jul 28 01:43:03.855195 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.855159    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:03.932508 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.932470    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68fcq\" (UniqueName: \"kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-kube-api-access-68fcq\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:03.932716 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.932526    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-certs\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:03.932716 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.932559    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-data\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:03.932716 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.932646    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-socket\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:03.932716 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.932703    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93ad9360-0a29-4a2a-ac78-2a8032461af7-istiod-ca-cert\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:03.933199 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.932730    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-credential-socket\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:03.933199 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.932766    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-token\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:03.933199 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.932794    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-envoy\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:03.933199 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:03.932872    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-podinfo\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034351 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034320    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93ad9360-0a29-4a2a-ac78-2a8032461af7-istiod-ca-cert\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034351 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034352    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-credential-socket\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034384    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-token\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034405    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-envoy\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034431    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-podinfo\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034470    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68fcq\" (UniqueName: \"kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-kube-api-access-68fcq\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034491    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-certs\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034512    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-data\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034552    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-socket\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034975 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034878    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-credential-socket\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.034975 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034906    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-certs\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.035042 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.034996    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-socket\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.035116 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.035099    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-data\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.035308 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.035288    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93ad9360-0a29-4a2a-ac78-2a8032461af7-istiod-ca-cert\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.036976 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.036928    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-envoy\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.037188 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.037170    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-podinfo\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.042522 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.042500    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-token\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.042879 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.042862    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68fcq\" (UniqueName: \"kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-kube-api-access-68fcq\") pod \"e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") " pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.122334 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.122250    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:04.146165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.146107    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:04.295922 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.295895    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"]
Jul 28 01:43:04.297062 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:43:04.297023    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ad9360_0a29_4a2a_ac78_2a8032461af7.slice/crio-df8528ba48b695b49201838237dc63e9c5d9b07bec29d04e45e7b56547ede979 WatchSource:0}: Error finding container df8528ba48b695b49201838237dc63e9c5d9b07bec29d04e45e7b56547ede979: Status 404 returned error can't find the container with id df8528ba48b695b49201838237dc63e9c5d9b07bec29d04e45e7b56547ede979
Jul 28 01:43:04.299291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.299256    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:43:04.299397 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.299338    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:43:04.299397 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.299382    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:43:04.389014 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.388974    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" event={"ID":"93ad9360-0a29-4a2a-ac78-2a8032461af7","Type":"ContainerStarted","Data":"dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5"}
Jul 28 01:43:04.389246 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.389039    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" event={"ID":"93ad9360-0a29-4a2a-ac78-2a8032461af7","Type":"ContainerStarted","Data":"df8528ba48b695b49201838237dc63e9c5d9b07bec29d04e45e7b56547ede979"}
Jul 28 01:43:04.410551 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:04.410489    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" podStartSLOduration=1.410471269 podStartE2EDuration="1.410471269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:43:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:43:04.407951692 +0000 UTC m=+2317.022259763" watchObservedRunningTime="2026-07-28 01:43:04.410471269 +0000 UTC m=+2317.024779341"
Jul 28 01:43:05.146959 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:05.146927    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:05.152180 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:05.152120    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:05.395450 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:05.395415    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:05.396530 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:05.396506    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:06.251694 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:06.251658    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:06.427962 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:06.427925    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:06.520681 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:06.520591    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:06.720434 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:06.720397    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:06.879605 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:06.879513    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:07.261612 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:07.261575    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:07.366270 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:07.366214    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:18.469545 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:18.469504    2552 generic.go:356] "Generic (PLEG): container finished" podID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerID="dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5" exitCode=0
Jul 28 01:43:18.470160 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:18.470111    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" event={"ID":"93ad9360-0a29-4a2a-ac78-2a8032461af7","Type":"ContainerDied","Data":"dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5"}
Jul 28 01:43:18.475064 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:18.471235    2552 scope.go:117] "RemoveContainer" containerID="dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5"
Jul 28 01:43:18.476179 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:18.476123    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:43:18.476251 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:18.476231    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:43:18.476299 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:18.476283    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:43:19.482677 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:19.482632    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" event={"ID":"93ad9360-0a29-4a2a-ac78-2a8032461af7","Type":"ContainerStarted","Data":"a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0"}
Jul 28 01:43:20.146937 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:20.146898    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:20.148213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:20.148178    2552 patch_prober.go:28] interesting pod/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 01:43:20.148335 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:20.148231    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 01:43:20.396151 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:20.396096    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:21.146691 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:21.146654    2552 patch_prober.go:28] interesting pod/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 01:43:21.147085 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:21.146709    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 01:43:22.147197 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:22.147160    2552 patch_prober.go:28] interesting pod/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 01:43:22.147590 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:22.147222    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 01:43:23.147543 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:23.147497    2552 patch_prober.go:28] interesting pod/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Jul 28 01:43:23.148025 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:23.147583    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Jul 28 01:43:24.150695 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:24.150658    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:24.151688 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:24.151667    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:43:25.236591 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:25.236555    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:31.385125 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:31.385091    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:37.146935 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:37.146898    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:43:59.437960 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:43:59.437921    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:40.825462 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:40.825425    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:41.778621 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:41.778569    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:52.521508 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:52.521408    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:52.615568 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:52.615538    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:52.703006 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:52.702971    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:53.097754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:53.097710    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:56.788201 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:56.788162    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:56.849524 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:56.849490    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:58.954927 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:58.954896    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:59.020745 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:59.020708    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:59.211596 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:59.211503    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"]
Jul 28 01:44:59.211800 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:59.211773    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy" containerID="cri-o://5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672" gracePeriod=30
Jul 28 01:44:59.233392 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:59.233337    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:44:59.454963 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:44:59.454925    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:04.479598 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.479526    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:45:04.633040 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633001    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-credential-socket\") pod \"408d0a74-7084-4898-bcb6-bf58beecfa92\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") "
Jul 28 01:45:04.633265 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633051    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-token\") pod \"408d0a74-7084-4898-bcb6-bf58beecfa92\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") "
Jul 28 01:45:04.633265 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633087    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408d0a74-7084-4898-bcb6-bf58beecfa92-istiod-ca-cert\") pod \"408d0a74-7084-4898-bcb6-bf58beecfa92\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") "
Jul 28 01:45:04.633265 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633114    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-envoy\") pod \"408d0a74-7084-4898-bcb6-bf58beecfa92\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") "
Jul 28 01:45:04.633265 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633180    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-socket\") pod \"408d0a74-7084-4898-bcb6-bf58beecfa92\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") "
Jul 28 01:45:04.633265 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633208    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-data\") pod \"408d0a74-7084-4898-bcb6-bf58beecfa92\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") "
Jul 28 01:45:04.633534 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633269    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-certs\") pod \"408d0a74-7084-4898-bcb6-bf58beecfa92\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") "
Jul 28 01:45:04.633534 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633299    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqtk6\" (UniqueName: \"kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-kube-api-access-pqtk6\") pod \"408d0a74-7084-4898-bcb6-bf58beecfa92\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") "
Jul 28 01:45:04.633534 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633377    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-podinfo\") pod \"408d0a74-7084-4898-bcb6-bf58beecfa92\" (UID: \"408d0a74-7084-4898-bcb6-bf58beecfa92\") "
Jul 28 01:45:04.633534 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633397    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "408d0a74-7084-4898-bcb6-bf58beecfa92" (UID: "408d0a74-7084-4898-bcb6-bf58beecfa92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:04.633735 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633563    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "408d0a74-7084-4898-bcb6-bf58beecfa92" (UID: "408d0a74-7084-4898-bcb6-bf58beecfa92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:04.633735 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633640    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/408d0a74-7084-4898-bcb6-bf58beecfa92-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "408d0a74-7084-4898-bcb6-bf58beecfa92" (UID: "408d0a74-7084-4898-bcb6-bf58beecfa92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:45:04.633735 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633649    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "408d0a74-7084-4898-bcb6-bf58beecfa92" (UID: "408d0a74-7084-4898-bcb6-bf58beecfa92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:04.633877 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633752    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:04.633877 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633769    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/408d0a74-7084-4898-bcb6-bf58beecfa92-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:04.633877 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633783    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:04.633877 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.633796    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:04.634161 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.634105    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-data" (OuterVolumeSpecName: "istio-data") pod "408d0a74-7084-4898-bcb6-bf58beecfa92" (UID: "408d0a74-7084-4898-bcb6-bf58beecfa92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:04.635675 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.635641    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-token" (OuterVolumeSpecName: "istio-token") pod "408d0a74-7084-4898-bcb6-bf58beecfa92" (UID: "408d0a74-7084-4898-bcb6-bf58beecfa92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:45:04.635820 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.635773    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "408d0a74-7084-4898-bcb6-bf58beecfa92" (UID: "408d0a74-7084-4898-bcb6-bf58beecfa92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:45:04.636093 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.636070    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "408d0a74-7084-4898-bcb6-bf58beecfa92" (UID: "408d0a74-7084-4898-bcb6-bf58beecfa92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:04.636093 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.636075    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-kube-api-access-pqtk6" (OuterVolumeSpecName: "kube-api-access-pqtk6") pod "408d0a74-7084-4898-bcb6-bf58beecfa92" (UID: "408d0a74-7084-4898-bcb6-bf58beecfa92"). InnerVolumeSpecName "kube-api-access-pqtk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:45:04.735205 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.735098    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:04.735205 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.735168    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:04.735205 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.735179    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqtk6\" (UniqueName: \"kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-kube-api-access-pqtk6\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:04.735205 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.735188    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:04.735205 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:04.735199    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/408d0a74-7084-4898-bcb6-bf58beecfa92-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:05.102338 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.102248    2552 generic.go:356] "Generic (PLEG): container finished" podID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerID="5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672" exitCode=0
Jul 28 01:45:05.102338 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.102291    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" event={"ID":"408d0a74-7084-4898-bcb6-bf58beecfa92","Type":"ContainerDied","Data":"5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672"}
Jul 28 01:45:05.102338 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.102299    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"
Jul 28 01:45:05.102338 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.102337    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt" event={"ID":"408d0a74-7084-4898-bcb6-bf58beecfa92","Type":"ContainerDied","Data":"9038f6b09364ff6dd4f3cbbb608c20f0d72d47ad94964beb098dfc1c6b345604"}
Jul 28 01:45:05.102639 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.102358    2552 scope.go:117] "RemoveContainer" containerID="5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672"
Jul 28 01:45:05.112278 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.112251    2552 scope.go:117] "RemoveContainer" containerID="0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d"
Jul 28 01:45:05.121214 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.121195    2552 scope.go:117] "RemoveContainer" containerID="5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672"
Jul 28 01:45:05.121533 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:45:05.121502    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672\": container with ID starting with 5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672 not found: ID does not exist" containerID="5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672"
Jul 28 01:45:05.121631 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.121547    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672"} err="failed to get container status \"5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672\": rpc error: code = NotFound desc = could not find container \"5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672\": container with ID starting with 5e65794ad9a13a765eae6e98dc15869aefe8ee29e0d32f458e15ae6d5399e672 not found: ID does not exist"
Jul 28 01:45:05.121631 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.121570    2552 scope.go:117] "RemoveContainer" containerID="0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d"
Jul 28 01:45:05.121827 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:45:05.121805    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d\": container with ID starting with 0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d not found: ID does not exist" containerID="0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d"
Jul 28 01:45:05.121872 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.121839    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d"} err="failed to get container status \"0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d\": rpc error: code = NotFound desc = could not find container \"0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d\": container with ID starting with 0b935edbc07215fcad234bb22be55b0aedefc0f599c58e8097153bac1aea098d not found: ID does not exist"
Jul 28 01:45:05.125169 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.125147    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"]
Jul 28 01:45:05.129032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:05.129008    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-45a9e6-openshift-default-7d9f6c85f4-jvcdt"]
Jul 28 01:45:06.029377 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:06.029283    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" path="/var/lib/kubelet/pods/408d0a74-7084-4898-bcb6-bf58beecfa92/volumes"
Jul 28 01:45:10.182142 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:10.182089    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:10.258821 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:10.258791    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:10.323102 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:10.323059    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:10.397915 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:10.397878    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:10.739295 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:10.739257    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:16.471196 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:16.471156    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:16.571673 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:16.571636    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:16.709658 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:16.709626    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"]
Jul 28 01:45:16.709893 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:16.709869    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy" containerID="cri-o://a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0" gracePeriod=30
Jul 28 01:45:16.784392 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:16.784309    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:16.952397 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:16.952362    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:17.311174 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.311125    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:17.593721 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.593641    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"]
Jul 28 01:45:17.594074 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.594055    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy"
Jul 28 01:45:17.594074 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.594067    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy"
Jul 28 01:45:17.594209 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.594112    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy"
Jul 28 01:45:17.594209 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.594118    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy"
Jul 28 01:45:17.594209 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.594203    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy"
Jul 28 01:45:17.594320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.594213    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="408d0a74-7084-4898-bcb6-bf58beecfa92" containerName="istio-proxy"
Jul 28 01:45:17.598914 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.598896    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.601462 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.601443    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ea62b7-openshift-default-dockercfg-m8vp5\""
Jul 28 01:45:17.620968 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.620940    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"]
Jul 28 01:45:17.625714 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.625689    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:17.653800 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.653765    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c80c7d-524a-45b9-9cff-227162acd813-istio-podinfo\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.653800 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.653803    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-istio-token\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.654008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.653875    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c80c7d-524a-45b9-9cff-227162acd813-istiod-ca-cert\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.654008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.653922    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-certs\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.654008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.653948    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-credential-socket\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.654008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.653969    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-envoy\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.654008 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.653997    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd66d\" (UniqueName: \"kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-kube-api-access-zd66d\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.654342 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.654076    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-socket\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.654342 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.654119    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-data\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.754939 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.754901    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-certs\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.754939 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.754944    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-credential-socket\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.754965    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-envoy\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.754992    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd66d\" (UniqueName: \"kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-kube-api-access-zd66d\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.755031    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-socket\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.755054    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-data\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.755087    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c80c7d-524a-45b9-9cff-227162acd813-istio-podinfo\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.755109    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-istio-token\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.755184    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c80c7d-524a-45b9-9cff-227162acd813-istiod-ca-cert\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755585 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.755413    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-certs\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755585 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.755462    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-credential-socket\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755585 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.755545    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-socket\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755858 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.755837    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-data\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.755903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.755890    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c80c7d-524a-45b9-9cff-227162acd813-istiod-ca-cert\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.757498 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.757472    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-envoy\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.757729 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.757707    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c80c7d-524a-45b9-9cff-227162acd813-istio-podinfo\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.766196 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.766171    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-istio-token\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.766455 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.766428    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd66d\" (UniqueName: \"kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-kube-api-access-zd66d\") pod \"e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") " pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:17.795258 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.795221    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:17.909388 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:17.909352    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:18.052668 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:18.052640    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"]
Jul 28 01:45:18.053823 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:45:18.053801    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c80c7d_524a_45b9_9cff_227162acd813.slice/crio-783f52d1496918beaa48a8ae4cf324056fa53e4f897a85af8a30e2085f2af855 WatchSource:0}: Error finding container 783f52d1496918beaa48a8ae4cf324056fa53e4f897a85af8a30e2085f2af855: Status 404 returned error can't find the container with id 783f52d1496918beaa48a8ae4cf324056fa53e4f897a85af8a30e2085f2af855
Jul 28 01:45:18.055951 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:18.055921    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:45:18.056017 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:18.055990    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:45:18.056052 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:18.056018    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:45:18.178452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:18.178351    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" event={"ID":"23c80c7d-524a-45b9-9cff-227162acd813","Type":"ContainerStarted","Data":"59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218"}
Jul 28 01:45:18.178452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:18.178424    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" event={"ID":"23c80c7d-524a-45b9-9cff-227162acd813","Type":"ContainerStarted","Data":"783f52d1496918beaa48a8ae4cf324056fa53e4f897a85af8a30e2085f2af855"}
Jul 28 01:45:18.199903 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:18.199847    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" podStartSLOduration=1.199829785 podStartE2EDuration="1.199829785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:45:18.197296665 +0000 UTC m=+2450.811604763" watchObservedRunningTime="2026-07-28 01:45:18.199829785 +0000 UTC m=+2450.814137857"
Jul 28 01:45:18.909861 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:18.909819    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:19.914787 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:19.914755    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:20.125863 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:20.125824    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:20.190440 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:20.190351    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:20.191420 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:20.191399    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:20.212381 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:20.212351    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:20.283221 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:20.283182    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:20.736012 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:20.735974    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:20.836759 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:20.836722    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:20.929320 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:20.929275    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:21.980741 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:21.980676    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:45:22.100344 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100311    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-envoy\") pod \"93ad9360-0a29-4a2a-ac78-2a8032461af7\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") "
Jul 28 01:45:22.100344 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100356    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93ad9360-0a29-4a2a-ac78-2a8032461af7-istiod-ca-cert\") pod \"93ad9360-0a29-4a2a-ac78-2a8032461af7\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") "
Jul 28 01:45:22.100622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100379    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-token\") pod \"93ad9360-0a29-4a2a-ac78-2a8032461af7\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") "
Jul 28 01:45:22.100622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100405    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-credential-socket\") pod \"93ad9360-0a29-4a2a-ac78-2a8032461af7\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") "
Jul 28 01:45:22.100622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100426    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-socket\") pod \"93ad9360-0a29-4a2a-ac78-2a8032461af7\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") "
Jul 28 01:45:22.100622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100450    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-certs\") pod \"93ad9360-0a29-4a2a-ac78-2a8032461af7\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") "
Jul 28 01:45:22.100622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100510    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68fcq\" (UniqueName: \"kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-kube-api-access-68fcq\") pod \"93ad9360-0a29-4a2a-ac78-2a8032461af7\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") "
Jul 28 01:45:22.100622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100536    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-podinfo\") pod \"93ad9360-0a29-4a2a-ac78-2a8032461af7\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") "
Jul 28 01:45:22.100622 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100617    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-data\") pod \"93ad9360-0a29-4a2a-ac78-2a8032461af7\" (UID: \"93ad9360-0a29-4a2a-ac78-2a8032461af7\") "
Jul 28 01:45:22.101023 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100726    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93ad9360-0a29-4a2a-ac78-2a8032461af7" (UID: "93ad9360-0a29-4a2a-ac78-2a8032461af7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:22.101023 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100806    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93ad9360-0a29-4a2a-ac78-2a8032461af7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93ad9360-0a29-4a2a-ac78-2a8032461af7" (UID: "93ad9360-0a29-4a2a-ac78-2a8032461af7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:45:22.101023 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100835    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93ad9360-0a29-4a2a-ac78-2a8032461af7" (UID: "93ad9360-0a29-4a2a-ac78-2a8032461af7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:22.101023 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.100991    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93ad9360-0a29-4a2a-ac78-2a8032461af7" (UID: "93ad9360-0a29-4a2a-ac78-2a8032461af7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:22.101256 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.101110    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93ad9360-0a29-4a2a-ac78-2a8032461af7-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:22.101256 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.101150    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:22.101256 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.101165    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:22.101256 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.101180    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:22.102160 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.102112    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-data" (OuterVolumeSpecName: "istio-data") pod "93ad9360-0a29-4a2a-ac78-2a8032461af7" (UID: "93ad9360-0a29-4a2a-ac78-2a8032461af7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:22.103020 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.102998    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93ad9360-0a29-4a2a-ac78-2a8032461af7" (UID: "93ad9360-0a29-4a2a-ac78-2a8032461af7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:45:22.103438 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.103420    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-kube-api-access-68fcq" (OuterVolumeSpecName: "kube-api-access-68fcq") pod "93ad9360-0a29-4a2a-ac78-2a8032461af7" (UID: "93ad9360-0a29-4a2a-ac78-2a8032461af7"). InnerVolumeSpecName "kube-api-access-68fcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:45:22.103438 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.103425    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93ad9360-0a29-4a2a-ac78-2a8032461af7" (UID: "93ad9360-0a29-4a2a-ac78-2a8032461af7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:45:22.103754 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.103738    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-token" (OuterVolumeSpecName: "istio-token") pod "93ad9360-0a29-4a2a-ac78-2a8032461af7" (UID: "93ad9360-0a29-4a2a-ac78-2a8032461af7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:45:22.201760 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.201725    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68fcq\" (UniqueName: \"kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-kube-api-access-68fcq\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:22.201760 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.201754    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:22.201760 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.201763    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:22.201760 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.201773    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:22.202096 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.201780    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93ad9360-0a29-4a2a-ac78-2a8032461af7-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:45:22.203348 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.203323    2552 generic.go:356] "Generic (PLEG): container finished" podID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerID="a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0" exitCode=0
Jul 28 01:45:22.203465 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.203376    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"
Jul 28 01:45:22.203465 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.203412    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" event={"ID":"93ad9360-0a29-4a2a-ac78-2a8032461af7","Type":"ContainerDied","Data":"a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0"}
Jul 28 01:45:22.203555 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.203467    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb" event={"ID":"93ad9360-0a29-4a2a-ac78-2a8032461af7","Type":"ContainerDied","Data":"df8528ba48b695b49201838237dc63e9c5d9b07bec29d04e45e7b56547ede979"}
Jul 28 01:45:22.203555 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.203489    2552 scope.go:117] "RemoveContainer" containerID="a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0"
Jul 28 01:45:22.213642 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.213623    2552 scope.go:117] "RemoveContainer" containerID="dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5"
Jul 28 01:45:22.222516 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.222496    2552 scope.go:117] "RemoveContainer" containerID="a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0"
Jul 28 01:45:22.222815 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:45:22.222796    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0\": container with ID starting with a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0 not found: ID does not exist" containerID="a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0"
Jul 28 01:45:22.222864 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.222828    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0"} err="failed to get container status \"a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0\": rpc error: code = NotFound desc = could not find container \"a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0\": container with ID starting with a30fbe7e2023d2fd44dc4b39bb4ae10aefaa82a25d26afec058fe52df9b610f0 not found: ID does not exist"
Jul 28 01:45:22.222864 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.222846    2552 scope.go:117] "RemoveContainer" containerID="dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5"
Jul 28 01:45:22.223086 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:45:22.223069    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5\": container with ID starting with dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5 not found: ID does not exist" containerID="dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5"
Jul 28 01:45:22.223198 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.223094    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5"} err="failed to get container status \"dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5\": rpc error: code = NotFound desc = could not find container \"dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5\": container with ID starting with dcca75d28f87b79370d5a254be5c0ca5511fd0d5253a63a5d58e0335170f23b5 not found: ID does not exist"
Jul 28 01:45:22.231315 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.231212    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"]
Jul 28 01:45:22.234115 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:22.234094    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a5bff2-openshift-default-6cbfdbfb7b-hzpgb"]
Jul 28 01:45:24.023159 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:24.023110    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" path="/var/lib/kubelet/pods/93ad9360-0a29-4a2a-ac78-2a8032461af7/volumes"
Jul 28 01:45:34.279224 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:34.279192    2552 generic.go:356] "Generic (PLEG): container finished" podID="23c80c7d-524a-45b9-9cff-227162acd813" containerID="59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218" exitCode=0
Jul 28 01:45:34.279702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:34.279255    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" event={"ID":"23c80c7d-524a-45b9-9cff-227162acd813","Type":"ContainerDied","Data":"59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218"}
Jul 28 01:45:34.279702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:34.279691    2552 scope.go:117] "RemoveContainer" containerID="59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218"
Jul 28 01:45:34.280772 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:34.280742    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:45:34.280849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:34.280829    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:45:34.280904 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:34.280890    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:45:35.190971 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:35.190941    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:35.290589 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:35.290550    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" event={"ID":"23c80c7d-524a-45b9-9cff-227162acd813","Type":"ContainerStarted","Data":"13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c"}
Jul 28 01:45:35.910486 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:35.910443    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:35.911589 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:35.911564    2552 patch_prober.go:28] interesting pod/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 28 01:45:35.911697 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:35.911613    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 28 01:45:36.910098 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:36.910062    2552 patch_prober.go:28] interesting pod/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 28 01:45:36.910510 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:36.910120    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 28 01:45:37.909749 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:37.909710    2552 patch_prober.go:28] interesting pod/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 28 01:45:37.909943 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:37.909765    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 28 01:45:38.910525 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:38.910481    2552 patch_prober.go:28] interesting pod/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Jul 28 01:45:38.910949 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:38.910544    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Jul 28 01:45:39.913576 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:39.913548    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:39.913963 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:39.913827    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:39.914603 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:39.914585    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:45:45.118738 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.118702    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:45.679298 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.679247    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:45.921199 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.921159    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"]
Jul 28 01:45:45.921793 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.921768    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy"
Jul 28 01:45:45.921904 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.921796    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy"
Jul 28 01:45:45.921904 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.921900    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy"
Jul 28 01:45:45.924504 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.924481    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:45.926913 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.926888    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5e7618-openshift-default-dockercfg-dvxpv\""
Jul 28 01:45:45.936377 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.936345    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"]
Jul 28 01:45:45.950759 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.950728    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:45.952059 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.952018    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/964adb04-e587-415e-9977-4fe3f710bf05-istio-podinfo\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:45.952059 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.952052    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/964adb04-e587-415e-9977-4fe3f710bf05-istiod-ca-cert\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:45.952291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.952088    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj768\" (UniqueName: \"kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-kube-api-access-kj768\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:45.952291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.952120    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-data\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:45.952291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.952160    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-istio-token\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:45.952291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.952191    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-certs\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:45.952291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.952218    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-credential-socket\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:45.952573 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.952295    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-envoy\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:45.952573 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:45.952357    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-socket\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.052982 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.052940    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-socket\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.053196 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.053071    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/964adb04-e587-415e-9977-4fe3f710bf05-istio-podinfo\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.053196 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.053107    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/964adb04-e587-415e-9977-4fe3f710bf05-istiod-ca-cert\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.053333 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.053211    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj768\" (UniqueName: \"kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-kube-api-access-kj768\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.053472 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.053442    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-socket\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.053643 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.053488    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-data\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.053730 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.053666    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-istio-token\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.053730 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.053718    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-certs\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.053853 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.053760    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-credential-socket\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.053853 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.053761    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-data\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.053970 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.053858    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-envoy\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.054028 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.054007    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-certs\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.054083 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.054036    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/964adb04-e587-415e-9977-4fe3f710bf05-istiod-ca-cert\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.054083 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.054067    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-credential-socket\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.056348 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.056322    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/964adb04-e587-415e-9977-4fe3f710bf05-istio-podinfo\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.056438 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.056322    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-envoy\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.061876 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.061851    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-istio-token\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.061991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.061968    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj768\" (UniqueName: \"kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-kube-api-access-kj768\") pod \"e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") " pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.236330 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.236237    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:46.382035 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.382009    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"]
Jul 28 01:45:46.384359 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:45:46.384331    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod964adb04_e587_415e_9977_4fe3f710bf05.slice/crio-f5fb95180d61a83ca8c182d54b842833001ec14a3c8c9e3078826e5898417fca WatchSource:0}: Error finding container f5fb95180d61a83ca8c182d54b842833001ec14a3c8c9e3078826e5898417fca: Status 404 returned error can't find the container with id f5fb95180d61a83ca8c182d54b842833001ec14a3c8c9e3078826e5898417fca
Jul 28 01:45:46.386697 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.386650    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:45:46.386789 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.386750    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:45:46.386830 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.386799    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:45:46.476991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:46.476959    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:47.360840 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:47.360808    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" event={"ID":"964adb04-e587-415e-9977-4fe3f710bf05","Type":"ContainerStarted","Data":"0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf"}
Jul 28 01:45:47.361262 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:47.360865    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" event={"ID":"964adb04-e587-415e-9977-4fe3f710bf05","Type":"ContainerStarted","Data":"f5fb95180d61a83ca8c182d54b842833001ec14a3c8c9e3078826e5898417fca"}
Jul 28 01:45:47.385427 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:47.385378    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" podStartSLOduration=2.385362699 podStartE2EDuration="2.385362699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:45:47.382950715 +0000 UTC m=+2479.997258781" watchObservedRunningTime="2026-07-28 01:45:47.385362699 +0000 UTC m=+2479.999670770"
Jul 28 01:45:48.236460 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:48.236428    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:48.241232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:48.241206    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:48.366549 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:48.366507    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:48.367506 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:48.367478    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:45:49.320793 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:49.320754    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:49.428932 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:49.428886    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:49.524121 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:49.524073    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:50.107551 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:50.107515    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:50.204911 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:50.204870    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:45:50.293561 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:45:50.293524    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:04.407379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:04.407328    2552 patch_prober.go:28] interesting pod/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 01:46:04.407957 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:04.407431    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 01:46:05.464879 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:05.464839    2552 generic.go:356] "Generic (PLEG): container finished" podID="964adb04-e587-415e-9977-4fe3f710bf05" containerID="0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf" exitCode=0
Jul 28 01:46:05.465340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:05.464887    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" event={"ID":"964adb04-e587-415e-9977-4fe3f710bf05","Type":"ContainerDied","Data":"0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf"}
Jul 28 01:46:05.465340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:05.465273    2552 scope.go:117] "RemoveContainer" containerID="0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf"
Jul 28 01:46:05.466330 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:05.466300    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:46:05.466429 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:05.466410    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:46:05.466468 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:05.466455    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:46:06.476490 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:06.476442    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" event={"ID":"964adb04-e587-415e-9977-4fe3f710bf05","Type":"ContainerStarted","Data":"ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e"}
Jul 28 01:46:07.236710 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:07.236670    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:46:07.236920 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:07.236898    2552 patch_prober.go:28] interesting pod/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 28 01:46:07.236978 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:07.236958    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 28 01:46:08.237332 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:08.237289    2552 patch_prober.go:28] interesting pod/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 28 01:46:08.237738 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:08.237347    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 28 01:46:09.236730 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:09.236693    2552 patch_prober.go:28] interesting pod/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 28 01:46:09.236915 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:09.236759    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 28 01:46:10.237534 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:10.237495    2552 patch_prober.go:28] interesting pod/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 28 01:46:10.237939 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:10.237555    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 28 01:46:11.241251 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:11.241219    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:46:11.241705 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:11.241679    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:46:11.242235 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:11.242215    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:46:14.339851 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:14.339811    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:32.850942 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:32.850900    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:32.934638 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:32.934594    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:33.000672 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:33.000635    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:33.077341 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:33.077248    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:33.435366 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:33.435328    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:39.036115 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:39.036075    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:39.110183 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:39.110097    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:39.286483 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:39.286401    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"]
Jul 28 01:46:39.286712 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:39.286668    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy" containerID="cri-o://13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c" gracePeriod=30
Jul 28 01:46:39.307915 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:39.307648    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:39.523254 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:39.523217    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:39.916258 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:39.916218    2552 patch_prober.go:28] interesting pod/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 01:46:39.916426 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:39.916296    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:46:44.561825 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.561764    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:46:44.648053 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.647999    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-envoy\") pod \"23c80c7d-524a-45b9-9cff-227162acd813\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") "
Jul 28 01:46:44.648053 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648050    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-socket\") pod \"23c80c7d-524a-45b9-9cff-227162acd813\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") "
Jul 28 01:46:44.648360 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648095    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-data\") pod \"23c80c7d-524a-45b9-9cff-227162acd813\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") "
Jul 28 01:46:44.648360 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648114    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-istio-token\") pod \"23c80c7d-524a-45b9-9cff-227162acd813\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") "
Jul 28 01:46:44.648360 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648168    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c80c7d-524a-45b9-9cff-227162acd813-istio-podinfo\") pod \"23c80c7d-524a-45b9-9cff-227162acd813\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") "
Jul 28 01:46:44.648360 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648192    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c80c7d-524a-45b9-9cff-227162acd813-istiod-ca-cert\") pod \"23c80c7d-524a-45b9-9cff-227162acd813\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") "
Jul 28 01:46:44.648360 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648229    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-certs\") pod \"23c80c7d-524a-45b9-9cff-227162acd813\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") "
Jul 28 01:46:44.648360 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648270    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd66d\" (UniqueName: \"kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-kube-api-access-zd66d\") pod \"23c80c7d-524a-45b9-9cff-227162acd813\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") "
Jul 28 01:46:44.648360 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648328    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-credential-socket\") pod \"23c80c7d-524a-45b9-9cff-227162acd813\" (UID: \"23c80c7d-524a-45b9-9cff-227162acd813\") "
Jul 28 01:46:44.648661 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648405    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "23c80c7d-524a-45b9-9cff-227162acd813" (UID: "23c80c7d-524a-45b9-9cff-227162acd813"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:46:44.648661 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648554    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "23c80c7d-524a-45b9-9cff-227162acd813" (UID: "23c80c7d-524a-45b9-9cff-227162acd813"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:46:44.648661 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648600    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "23c80c7d-524a-45b9-9cff-227162acd813" (UID: "23c80c7d-524a-45b9-9cff-227162acd813"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:46:44.648661 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648623    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23c80c7d-524a-45b9-9cff-227162acd813-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "23c80c7d-524a-45b9-9cff-227162acd813" (UID: "23c80c7d-524a-45b9-9cff-227162acd813"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:46:44.649040 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648731    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:46:44.649040 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648750    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:46:44.649040 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648765    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23c80c7d-524a-45b9-9cff-227162acd813-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:46:44.649040 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.648783    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:46:44.649040 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.649015    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-data" (OuterVolumeSpecName: "istio-data") pod "23c80c7d-524a-45b9-9cff-227162acd813" (UID: "23c80c7d-524a-45b9-9cff-227162acd813"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:46:44.650472 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.650448    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "23c80c7d-524a-45b9-9cff-227162acd813" (UID: "23c80c7d-524a-45b9-9cff-227162acd813"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:46:44.650576 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.650540    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-istio-token" (OuterVolumeSpecName: "istio-token") pod "23c80c7d-524a-45b9-9cff-227162acd813" (UID: "23c80c7d-524a-45b9-9cff-227162acd813"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:46:44.651189 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.651105    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-kube-api-access-zd66d" (OuterVolumeSpecName: "kube-api-access-zd66d") pod "23c80c7d-524a-45b9-9cff-227162acd813" (UID: "23c80c7d-524a-45b9-9cff-227162acd813"). InnerVolumeSpecName "kube-api-access-zd66d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:46:44.651189 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.651099    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23c80c7d-524a-45b9-9cff-227162acd813-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "23c80c7d-524a-45b9-9cff-227162acd813" (UID: "23c80c7d-524a-45b9-9cff-227162acd813"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:46:44.698235 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.698199    2552 generic.go:356] "Generic (PLEG): container finished" podID="23c80c7d-524a-45b9-9cff-227162acd813" containerID="13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c" exitCode=0
Jul 28 01:46:44.698383 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.698245    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"
Jul 28 01:46:44.698383 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.698282    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" event={"ID":"23c80c7d-524a-45b9-9cff-227162acd813","Type":"ContainerDied","Data":"13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c"}
Jul 28 01:46:44.698383 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.698339    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68" event={"ID":"23c80c7d-524a-45b9-9cff-227162acd813","Type":"ContainerDied","Data":"783f52d1496918beaa48a8ae4cf324056fa53e4f897a85af8a30e2085f2af855"}
Jul 28 01:46:44.698383 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.698373    2552 scope.go:117] "RemoveContainer" containerID="13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c"
Jul 28 01:46:44.708461 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.708438    2552 scope.go:117] "RemoveContainer" containerID="59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218"
Jul 28 01:46:44.717934 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.717910    2552 scope.go:117] "RemoveContainer" containerID="13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c"
Jul 28 01:46:44.718276 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:46:44.718257    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c\": container with ID starting with 13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c not found: ID does not exist" containerID="13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c"
Jul 28 01:46:44.718337 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.718287    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c"} err="failed to get container status \"13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c\": rpc error: code = NotFound desc = could not find container \"13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c\": container with ID starting with 13a4bd1e29a993233edd412e1befe3469535a44e743b351fb511098e0cb8883c not found: ID does not exist"
Jul 28 01:46:44.718337 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.718307    2552 scope.go:117] "RemoveContainer" containerID="59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218"
Jul 28 01:46:44.718575 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:46:44.718555    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218\": container with ID starting with 59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218 not found: ID does not exist" containerID="59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218"
Jul 28 01:46:44.718623 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.718581    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218"} err="failed to get container status \"59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218\": rpc error: code = NotFound desc = could not find container \"59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218\": container with ID starting with 59af7cdc5c11e07fc8e101a71c94a46224696381c758254bfa0fbcf7990f4218 not found: ID does not exist"
Jul 28 01:46:44.722050 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.722028    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"]
Jul 28 01:46:44.726690 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.726662    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ea62b7-openshift-default-6d574cf95d-rjl68"]
Jul 28 01:46:44.749802 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.749762    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:46:44.749802 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.749793    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23c80c7d-524a-45b9-9cff-227162acd813-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:46:44.749802 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.749801    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:46:44.749802 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.749809    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23c80c7d-524a-45b9-9cff-227162acd813-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:46:44.750047 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:44.749818    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd66d\" (UniqueName: \"kubernetes.io/projected/23c80c7d-524a-45b9-9cff-227162acd813-kube-api-access-zd66d\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:46:46.025470 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:46.025433    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23c80c7d-524a-45b9-9cff-227162acd813" path="/var/lib/kubelet/pods/23c80c7d-524a-45b9-9cff-227162acd813/volumes"
Jul 28 01:46:55.321205 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:55.321156    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:55.426062 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:55.426021    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:55.505880 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:55.505847    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:55.575882 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:55.575804    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:46:55.912935 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:46:55.912905    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:02.050549 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:02.050514    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:02.152044 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:02.152011    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:02.319489 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:02.319403    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"]
Jul 28 01:47:02.319644 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:02.319610    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy" containerID="cri-o://ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e" gracePeriod=30
Jul 28 01:47:02.342736 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:02.342637    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:02.580478 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:02.580387    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:02.904814 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:02.904785    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:03.239695 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.239615    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"]
Jul 28 01:47:03.240051 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.240027    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy"
Jul 28 01:47:03.240051 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.240038    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy"
Jul 28 01:47:03.240126 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.240055    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy"
Jul 28 01:47:03.240126 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.240061    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy"
Jul 28 01:47:03.240126 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.240075    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy"
Jul 28 01:47:03.240126 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.240081    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy"
Jul 28 01:47:03.240126 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.240165    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy"
Jul 28 01:47:03.240336 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.240176    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c80c7d-524a-45b9-9cff-227162acd813" containerName="istio-proxy"
Jul 28 01:47:03.240336 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.240181    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="93ad9360-0a29-4a2a-ac78-2a8032461af7" containerName="istio-proxy"
Jul 28 01:47:03.242655 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.242638    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.246172 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.246153    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0337e8-openshift-default-dockercfg-r6cwl\""
Jul 28 01:47:03.274662 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.274629    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"]
Jul 28 01:47:03.276037 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.276006    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:03.424411 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.424379    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-credential-socket\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.424594 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.424423    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-envoy\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.424594 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.424461    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hss4\" (UniqueName: \"kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-kube-api-access-9hss4\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.424594 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.424515    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istiod-ca-cert\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.424594 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.424553    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-token\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.424594 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.424574    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-podinfo\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.424758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.424643    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-socket\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.424758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.424689    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-certs\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.424758 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.424725    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-data\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526123 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526036    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hss4\" (UniqueName: \"kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-kube-api-access-9hss4\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526123 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526077    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istiod-ca-cert\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526339 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526316    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-token\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526373 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526339    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-podinfo\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526373 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526364    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-socket\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526620 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526590    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-certs\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526690 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526674    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-data\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526739 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526690    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-socket\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526801 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526778    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-credential-socket\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526861 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526824    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-envoy\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526921 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526863    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istiod-ca-cert\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.526921 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526881    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-certs\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.527092 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.526999    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-data\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.527092 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.527049    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-credential-socket\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.529015 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.528994    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-podinfo\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.529015 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.529000    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-envoy\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.533899 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.533871    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-token\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.534031 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.533972    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hss4\" (UniqueName: \"kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-kube-api-access-9hss4\") pod \"e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") " pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.553046 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.553007    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:03.701090 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.701064    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"]
Jul 28 01:47:03.702829 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:47:03.702799    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad076bb7_da7c_4ff2_a3f9_f9572fb3f363.slice/crio-25abadd6b948335803aac8031ed0e7f13791baab9fac62dea7a09a026ebe95ae WatchSource:0}: Error finding container 25abadd6b948335803aac8031ed0e7f13791baab9fac62dea7a09a026ebe95ae: Status 404 returned error can't find the container with id 25abadd6b948335803aac8031ed0e7f13791baab9fac62dea7a09a026ebe95ae
Jul 28 01:47:03.705120 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.705077    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:03.705223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.705190    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:03.705265 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.705239    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:03.711453 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.711425    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:03.812910 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.812799    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" event={"ID":"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363","Type":"ContainerStarted","Data":"35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652"}
Jul 28 01:47:03.812910 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.812871    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" event={"ID":"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363","Type":"ContainerStarted","Data":"25abadd6b948335803aac8031ed0e7f13791baab9fac62dea7a09a026ebe95ae"}
Jul 28 01:47:03.833213 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:03.833151    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" podStartSLOduration=0.833110533 podStartE2EDuration="833.110533ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:47:03.831909549 +0000 UTC m=+2556.446217620" watchObservedRunningTime="2026-07-28 01:47:03.833110533 +0000 UTC m=+2556.447418606"
Jul 28 01:47:04.554186 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:04.554118    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:04.559168 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:04.559118    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:04.819118 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:04.819035    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:04.820176 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:04.820154    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:05.778296 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:05.778233    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:05.882224 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:05.882186    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:05.977751 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:05.977699    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:06.502521 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:06.502491    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:06.611493 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:06.611459    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:06.829094 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:06.828995    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:07.567399 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.567376    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:47:07.665386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665349    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-socket\") pod \"964adb04-e587-415e-9977-4fe3f710bf05\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") "
Jul 28 01:47:07.665592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665405    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-certs\") pod \"964adb04-e587-415e-9977-4fe3f710bf05\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") "
Jul 28 01:47:07.665592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665465    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj768\" (UniqueName: \"kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-kube-api-access-kj768\") pod \"964adb04-e587-415e-9977-4fe3f710bf05\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") "
Jul 28 01:47:07.665592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665492    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-istio-token\") pod \"964adb04-e587-415e-9977-4fe3f710bf05\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") "
Jul 28 01:47:07.665592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665525    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-data\") pod \"964adb04-e587-415e-9977-4fe3f710bf05\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") "
Jul 28 01:47:07.665592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665574    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-envoy\") pod \"964adb04-e587-415e-9977-4fe3f710bf05\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") "
Jul 28 01:47:07.665865 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665614    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-credential-socket\") pod \"964adb04-e587-415e-9977-4fe3f710bf05\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") "
Jul 28 01:47:07.665865 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665678    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/964adb04-e587-415e-9977-4fe3f710bf05-istio-podinfo\") pod \"964adb04-e587-415e-9977-4fe3f710bf05\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") "
Jul 28 01:47:07.665865 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665686    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "964adb04-e587-415e-9977-4fe3f710bf05" (UID: "964adb04-e587-415e-9977-4fe3f710bf05"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:47:07.665865 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665718    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/964adb04-e587-415e-9977-4fe3f710bf05-istiod-ca-cert\") pod \"964adb04-e587-415e-9977-4fe3f710bf05\" (UID: \"964adb04-e587-415e-9977-4fe3f710bf05\") "
Jul 28 01:47:07.665865 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665799    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "964adb04-e587-415e-9977-4fe3f710bf05" (UID: "964adb04-e587-415e-9977-4fe3f710bf05"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:47:07.666109 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.665906    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "964adb04-e587-415e-9977-4fe3f710bf05" (UID: "964adb04-e587-415e-9977-4fe3f710bf05"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:47:07.666109 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.666052    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:47:07.666109 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.666074    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:47:07.666109 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.666089    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:47:07.666109 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.666102    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/964adb04-e587-415e-9977-4fe3f710bf05-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "964adb04-e587-415e-9977-4fe3f710bf05" (UID: "964adb04-e587-415e-9977-4fe3f710bf05"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:47:07.666688 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.666663    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-data" (OuterVolumeSpecName: "istio-data") pod "964adb04-e587-415e-9977-4fe3f710bf05" (UID: "964adb04-e587-415e-9977-4fe3f710bf05"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:47:07.667993 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.667959    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "964adb04-e587-415e-9977-4fe3f710bf05" (UID: "964adb04-e587-415e-9977-4fe3f710bf05"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:47:07.668116 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.668017    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-kube-api-access-kj768" (OuterVolumeSpecName: "kube-api-access-kj768") pod "964adb04-e587-415e-9977-4fe3f710bf05" (UID: "964adb04-e587-415e-9977-4fe3f710bf05"). InnerVolumeSpecName "kube-api-access-kj768". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:47:07.668341 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.668321    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-istio-token" (OuterVolumeSpecName: "istio-token") pod "964adb04-e587-415e-9977-4fe3f710bf05" (UID: "964adb04-e587-415e-9977-4fe3f710bf05"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:47:07.668407 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.668317    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/964adb04-e587-415e-9977-4fe3f710bf05-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "964adb04-e587-415e-9977-4fe3f710bf05" (UID: "964adb04-e587-415e-9977-4fe3f710bf05"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:47:07.767571 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.767536    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:47:07.767571 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.767564    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/964adb04-e587-415e-9977-4fe3f710bf05-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:47:07.767571 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.767573    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/964adb04-e587-415e-9977-4fe3f710bf05-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:47:07.767809 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.767582    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj768\" (UniqueName: \"kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-kube-api-access-kj768\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:47:07.767809 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.767592    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/964adb04-e587-415e-9977-4fe3f710bf05-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:47:07.767809 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.767599    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/964adb04-e587-415e-9977-4fe3f710bf05-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:47:07.840055 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.840023    2552 generic.go:356] "Generic (PLEG): container finished" podID="964adb04-e587-415e-9977-4fe3f710bf05" containerID="ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e" exitCode=0
Jul 28 01:47:07.840550 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.840069    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" event={"ID":"964adb04-e587-415e-9977-4fe3f710bf05","Type":"ContainerDied","Data":"ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e"}
Jul 28 01:47:07.840550 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.840092    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"
Jul 28 01:47:07.840550 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.840124    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw" event={"ID":"964adb04-e587-415e-9977-4fe3f710bf05","Type":"ContainerDied","Data":"f5fb95180d61a83ca8c182d54b842833001ec14a3c8c9e3078826e5898417fca"}
Jul 28 01:47:07.840550 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.840164    2552 scope.go:117] "RemoveContainer" containerID="ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e"
Jul 28 01:47:07.850590 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.850569    2552 scope.go:117] "RemoveContainer" containerID="0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf"
Jul 28 01:47:07.863086 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.863057    2552 scope.go:117] "RemoveContainer" containerID="ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e"
Jul 28 01:47:07.863461 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:47:07.863442    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e\": container with ID starting with ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e not found: ID does not exist" containerID="ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e"
Jul 28 01:47:07.863546 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.863470    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e"} err="failed to get container status \"ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e\": rpc error: code = NotFound desc = could not find container \"ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e\": container with ID starting with ddf10bc5db26889b9466cd73f90c18ba2a533e6d706e75c586d856b6f3c08d2e not found: ID does not exist"
Jul 28 01:47:07.863546 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.863487    2552 scope.go:117] "RemoveContainer" containerID="0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf"
Jul 28 01:47:07.863767 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:47:07.863752    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf\": container with ID starting with 0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf not found: ID does not exist" containerID="0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf"
Jul 28 01:47:07.863808 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.863770    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf"} err="failed to get container status \"0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf\": rpc error: code = NotFound desc = could not find container \"0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf\": container with ID starting with 0bbf30a17332de5b269f3f4e49fd09fa5a3e994e9d6da090caf87c4a04300dbf not found: ID does not exist"
Jul 28 01:47:07.863962 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.863942    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"]
Jul 28 01:47:07.871395 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:07.871363    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5e7618-openshift-default-599d46c794-kfpfw"]
Jul 28 01:47:08.025111 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:08.025029    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="964adb04-e587-415e-9977-4fe3f710bf05" path="/var/lib/kubelet/pods/964adb04-e587-415e-9977-4fe3f710bf05/volumes"
Jul 28 01:47:19.820150 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:19.820099    2552 patch_prober.go:28] interesting pod/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 28 01:47:19.820568 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:19.820186    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 28 01:47:19.921799 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:19.921770    2552 generic.go:356] "Generic (PLEG): container finished" podID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerID="35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652" exitCode=0
Jul 28 01:47:19.921998 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:19.921850    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" event={"ID":"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363","Type":"ContainerDied","Data":"35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652"}
Jul 28 01:47:19.922307 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:19.922290    2552 scope.go:117] "RemoveContainer" containerID="35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652"
Jul 28 01:47:19.923322 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:19.923290    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:19.923413 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:19.923358    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:19.923413 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:19.923394    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:20.929194 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:20.929156    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" event={"ID":"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363","Type":"ContainerStarted","Data":"61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e"}
Jul 28 01:47:21.553353 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:21.553324    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:21.553556 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:21.553534    2552 patch_prober.go:28] interesting pod/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 28 01:47:21.553610 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:21.553581    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 28 01:47:22.554407 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:22.554371    2552 patch_prober.go:28] interesting pod/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 28 01:47:22.554790 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:22.554428    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 28 01:47:23.554228 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:23.554193    2552 patch_prober.go:28] interesting pod/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 28 01:47:23.554442 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:23.554252    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 28 01:47:24.553721 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:24.553688    2552 patch_prober.go:28] interesting pod/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Jul 28 01:47:24.553912 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:24.553745    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Jul 28 01:47:25.557529 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:25.557498    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:25.558025 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:25.557870    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:25.558664 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:25.558647    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 01:47:30.798659 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:30.798620    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:31.438617 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.438582    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"]
Jul 28 01:47:31.439031 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.439009    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy"
Jul 28 01:47:31.439031 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.439025    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy"
Jul 28 01:47:31.439229 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.439097    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy"
Jul 28 01:47:31.439229 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.439108    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy"
Jul 28 01:47:31.442385 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.442368    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.445535 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.445512    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-44b320-openshift-default-dockercfg-7j966\""
Jul 28 01:47:31.456891 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.456861    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"]
Jul 28 01:47:31.492798 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.492759    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-credential-socket\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.492953 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.492802    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc79t\" (UniqueName: \"kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-kube-api-access-sc79t\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.492953 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.492902    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49330d0e-11d8-4595-b483-35a2f79143fa-istio-podinfo\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.492953 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.492930    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-certs\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.493100 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.492963    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-envoy\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.493100 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.492988    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49330d0e-11d8-4595-b483-35a2f79143fa-istiod-ca-cert\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.493100 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.493038    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-socket\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.493100 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.493059    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-data\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.493100 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.493076    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-istio-token\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.593605 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.593562    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-socket\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.593605 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.593609    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-data\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.593862 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.593630    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-istio-token\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.593862 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.593659    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-credential-socket\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.593862 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.593787    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc79t\" (UniqueName: \"kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-kube-api-access-sc79t\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.594029 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.593901    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49330d0e-11d8-4595-b483-35a2f79143fa-istio-podinfo\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.594029 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.593945    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-certs\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.594176 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.594024    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-socket\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.594176 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.594085    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-envoy\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.594176 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.594091    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-data\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.594176 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.594112    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49330d0e-11d8-4595-b483-35a2f79143fa-istiod-ca-cert\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.594176 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.594173    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-credential-socket\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.594426 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.594317    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-certs\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.594619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.594602    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49330d0e-11d8-4595-b483-35a2f79143fa-istiod-ca-cert\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.596454 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.596426    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-envoy\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.596629 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.596609    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49330d0e-11d8-4595-b483-35a2f79143fa-istio-podinfo\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.603670 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.603640    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc79t\" (UniqueName: \"kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-kube-api-access-sc79t\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.604233 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.604215    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-istio-token\") pod \"e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") " pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.755352 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.755263    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:31.898535 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.898501    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:31.908880 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.908845    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"]
Jul 28 01:47:31.910596 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:47:31.910570    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49330d0e_11d8_4595_b483_35a2f79143fa.slice/crio-9f974783f219220cc0ced690d4fe22d7b141ef1c3a3b8ffa9a49471a660f56fb WatchSource:0}: Error finding container 9f974783f219220cc0ced690d4fe22d7b141ef1c3a3b8ffa9a49471a660f56fb: Status 404 returned error can't find the container with id 9f974783f219220cc0ced690d4fe22d7b141ef1c3a3b8ffa9a49471a660f56fb
Jul 28 01:47:31.913025 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.912987    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:31.913106 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.913062    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:31.913106 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.913096    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:31.993401 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.993366    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" event={"ID":"49330d0e-11d8-4595-b483-35a2f79143fa","Type":"ContainerStarted","Data":"b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470"}
Jul 28 01:47:31.993564 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.993421    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" event={"ID":"49330d0e-11d8-4595-b483-35a2f79143fa","Type":"ContainerStarted","Data":"9f974783f219220cc0ced690d4fe22d7b141ef1c3a3b8ffa9a49471a660f56fb"}
Jul 28 01:47:31.998533 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:31.998505    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:32.017373 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:32.017253    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" podStartSLOduration=1.017228173 podStartE2EDuration="1.017228173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:47:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:47:32.012562662 +0000 UTC m=+2584.626870734" watchObservedRunningTime="2026-07-28 01:47:32.017228173 +0000 UTC m=+2584.631536247"
Jul 28 01:47:32.756118 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:32.756075    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:32.763013 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:32.762986    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:32.999677 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:32.999650    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:33.000558 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:33.000541    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:34.093579 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:34.093547    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:34.252522 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:34.252483    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:34.352057 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:34.351966    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:34.486771 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:34.486728    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:34.983935 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:34.983896    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:35.088165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:35.088101    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:47:49.041331 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:49.041286    2552 patch_prober.go:28] interesting pod/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 01:47:49.042982 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:49.041360    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 01:47:50.102928 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:50.102896    2552 generic.go:356] "Generic (PLEG): container finished" podID="49330d0e-11d8-4595-b483-35a2f79143fa" containerID="b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470" exitCode=0
Jul 28 01:47:50.103394 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:50.102981    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" event={"ID":"49330d0e-11d8-4595-b483-35a2f79143fa","Type":"ContainerDied","Data":"b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470"}
Jul 28 01:47:50.103468 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:50.103412    2552 scope.go:117] "RemoveContainer" containerID="b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470"
Jul 28 01:47:50.104554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:50.104524    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:50.104649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:50.104633    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:50.104697 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:50.104684    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:47:51.117004 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:51.116966    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" event={"ID":"49330d0e-11d8-4595-b483-35a2f79143fa","Type":"ContainerStarted","Data":"737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347"}
Jul 28 01:47:51.756379 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:51.756342    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:51.756616 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:51.756594    2552 patch_prober.go:28] interesting pod/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 28 01:47:51.756726 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:51.756648    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 28 01:47:52.756772 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:52.756734    2552 patch_prober.go:28] interesting pod/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 28 01:47:52.757235 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:52.756789    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 28 01:47:53.755701 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:53.755655    2552 patch_prober.go:28] interesting pod/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 28 01:47:53.755912 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:53.755720    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 28 01:47:54.756702 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:54.756664    2552 patch_prober.go:28] interesting pod/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 28 01:47:54.757105 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:54.756738    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 28 01:47:55.759201 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:55.759170    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:55.759682 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:55.759486    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:55.760298 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:55.760276    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 01:47:59.070929 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:47:59.070883    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:05.445791 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:48:05.445753    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:48:25.560965 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:48:25.560928    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:49:20.439697 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:49:20.439603    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:50:36.849485 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:50:36.849443    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:15.045851 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:52:15.045820    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:15.104453 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:52:15.104398    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:29.555554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:52:29.555466    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:52.219691 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:52:52.219654    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:52:53.365815 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:52:53.365733    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:53:11.645587 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:53:11.645519    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:53:19.342366 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:53:19.342331    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:53:32.253497 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:53:32.253464    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:36.885386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:54:36.885349    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:54:37.669994 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:54:37.669964    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:01.018788 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:55:01.018751    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:55:31.482191 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:55:31.482109    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:38.981387 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:38.981348    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:39.943318 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:39.943287    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:40.872345 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:40.872310    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7347-140510529707312"]
Jul 28 01:56:40.872744 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:40.872735    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy"
Jul 28 01:56:40.872787 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:40.872759    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="964adb04-e587-415e-9977-4fe3f710bf05" containerName="istio-proxy"
Jul 28 01:56:40.875246 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:40.875231    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529707312"
Jul 28 01:56:40.877704 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:40.877680    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jfgn8\""
Jul 28 01:56:40.883122 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:40.883096    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529707312"]
Jul 28 01:56:40.979559 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:40.979530    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzmjb\" (UniqueName: \"kubernetes.io/projected/e30c306e-c1a7-4f23-890b-d674357c37c0-kube-api-access-lzmjb\") pod \"test-curl-7347-140510529707312\" (UID: \"e30c306e-c1a7-4f23-890b-d674357c37c0\") " pod="opendatahub/test-curl-7347-140510529707312"
Jul 28 01:56:41.080515 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:41.080476    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmjb\" (UniqueName: \"kubernetes.io/projected/e30c306e-c1a7-4f23-890b-d674357c37c0-kube-api-access-lzmjb\") pod \"test-curl-7347-140510529707312\" (UID: \"e30c306e-c1a7-4f23-890b-d674357c37c0\") " pod="opendatahub/test-curl-7347-140510529707312"
Jul 28 01:56:41.089650 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:41.089625    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzmjb\" (UniqueName: \"kubernetes.io/projected/e30c306e-c1a7-4f23-890b-d674357c37c0-kube-api-access-lzmjb\") pod \"test-curl-7347-140510529707312\" (UID: \"e30c306e-c1a7-4f23-890b-d674357c37c0\") " pod="opendatahub/test-curl-7347-140510529707312"
Jul 28 01:56:41.185211 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:41.185183    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529707312"
Jul 28 01:56:41.321284 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:41.321259    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529707312"]
Jul 28 01:56:41.323185 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:56:41.323123    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode30c306e_c1a7_4f23_890b_d674357c37c0.slice/crio-8fb9d7cd6c5eead93855b263d7688ec4dd9ee8a6dc1b55d066d6586e68883a57 WatchSource:0}: Error finding container 8fb9d7cd6c5eead93855b263d7688ec4dd9ee8a6dc1b55d066d6586e68883a57: Status 404 returned error can't find the container with id 8fb9d7cd6c5eead93855b263d7688ec4dd9ee8a6dc1b55d066d6586e68883a57
Jul 28 01:56:41.324521 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:41.324501    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 01:56:41.404376 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:41.404345    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:42.199372 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:42.199338    2552 generic.go:356] "Generic (PLEG): container finished" podID="e30c306e-c1a7-4f23-890b-d674357c37c0" containerID="e002f4738f12b1b89c1cd116e7d02a16edc497252c75cef2834aa4db50831e52" exitCode=0
Jul 28 01:56:42.199762 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:42.199417    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529707312" event={"ID":"e30c306e-c1a7-4f23-890b-d674357c37c0","Type":"ContainerDied","Data":"e002f4738f12b1b89c1cd116e7d02a16edc497252c75cef2834aa4db50831e52"}
Jul 28 01:56:42.199762 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:42.199444    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529707312" event={"ID":"e30c306e-c1a7-4f23-890b-d674357c37c0","Type":"ContainerStarted","Data":"8fb9d7cd6c5eead93855b263d7688ec4dd9ee8a6dc1b55d066d6586e68883a57"}
Jul 28 01:56:43.347401 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.347371    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529707312"
Jul 28 01:56:43.367835 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.367802    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7347-140510529707312_e30c306e-c1a7-4f23-890b-d674357c37c0/test-curl-7347-140510529707312/0.log"
Jul 28 01:56:43.391850 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.391814    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7347-140510529707312"]
Jul 28 01:56:43.394209 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.394186    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7347-140510529707312"]
Jul 28 01:56:43.504158 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.504030    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzmjb\" (UniqueName: \"kubernetes.io/projected/e30c306e-c1a7-4f23-890b-d674357c37c0-kube-api-access-lzmjb\") pod \"e30c306e-c1a7-4f23-890b-d674357c37c0\" (UID: \"e30c306e-c1a7-4f23-890b-d674357c37c0\") "
Jul 28 01:56:43.506388 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.506359    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30c306e-c1a7-4f23-890b-d674357c37c0-kube-api-access-lzmjb" (OuterVolumeSpecName: "kube-api-access-lzmjb") pod "e30c306e-c1a7-4f23-890b-d674357c37c0" (UID: "e30c306e-c1a7-4f23-890b-d674357c37c0"). InnerVolumeSpecName "kube-api-access-lzmjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:43.512688 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.512666    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7347-140510529704496"]
Jul 28 01:56:43.513115 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.513091    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30c306e-c1a7-4f23-890b-d674357c37c0" containerName="test-curl-7347-140510529707312"
Jul 28 01:56:43.513115 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.513110    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30c306e-c1a7-4f23-890b-d674357c37c0" containerName="test-curl-7347-140510529707312"
Jul 28 01:56:43.513314 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.513220    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30c306e-c1a7-4f23-890b-d674357c37c0" containerName="test-curl-7347-140510529707312"
Jul 28 01:56:43.515396 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.515382    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529704496"
Jul 28 01:56:43.523748 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.523723    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529704496"]
Jul 28 01:56:43.605473 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.605423    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzmjb\" (UniqueName: \"kubernetes.io/projected/e30c306e-c1a7-4f23-890b-d674357c37c0-kube-api-access-lzmjb\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:56:43.706263 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.706207    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rngmc\" (UniqueName: \"kubernetes.io/projected/8e67ab15-644b-435f-b792-843ac18d4227-kube-api-access-rngmc\") pod \"test-curl-7347-140510529704496\" (UID: \"8e67ab15-644b-435f-b792-843ac18d4227\") " pod="opendatahub/test-curl-7347-140510529704496"
Jul 28 01:56:43.807481 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.807380    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rngmc\" (UniqueName: \"kubernetes.io/projected/8e67ab15-644b-435f-b792-843ac18d4227-kube-api-access-rngmc\") pod \"test-curl-7347-140510529704496\" (UID: \"8e67ab15-644b-435f-b792-843ac18d4227\") " pod="opendatahub/test-curl-7347-140510529704496"
Jul 28 01:56:43.816025 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.815985    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rngmc\" (UniqueName: \"kubernetes.io/projected/8e67ab15-644b-435f-b792-843ac18d4227-kube-api-access-rngmc\") pod \"test-curl-7347-140510529704496\" (UID: \"8e67ab15-644b-435f-b792-843ac18d4227\") " pod="opendatahub/test-curl-7347-140510529704496"
Jul 28 01:56:43.825564 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.825533    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529704496"
Jul 28 01:56:43.965061 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:43.965031    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529704496"]
Jul 28 01:56:43.966855 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:56:43.966826    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e67ab15_644b_435f_b792_843ac18d4227.slice/crio-e73e5b4ddc54fb6de5b4704250b7fc3b9f6bacaa1725d77c23029f1c0a220ead WatchSource:0}: Error finding container e73e5b4ddc54fb6de5b4704250b7fc3b9f6bacaa1725d77c23029f1c0a220ead: Status 404 returned error can't find the container with id e73e5b4ddc54fb6de5b4704250b7fc3b9f6bacaa1725d77c23029f1c0a220ead
Jul 28 01:56:44.026720 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:44.026683    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e30c306e-c1a7-4f23-890b-d674357c37c0" path="/var/lib/kubelet/pods/e30c306e-c1a7-4f23-890b-d674357c37c0/volumes"
Jul 28 01:56:44.213525 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:44.213488    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529704496" event={"ID":"8e67ab15-644b-435f-b792-843ac18d4227","Type":"ContainerStarted","Data":"e73e5b4ddc54fb6de5b4704250b7fc3b9f6bacaa1725d77c23029f1c0a220ead"}
Jul 28 01:56:44.214641 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:44.214612    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529707312"
Jul 28 01:56:44.214750 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:44.214669    2552 scope.go:117] "RemoveContainer" containerID="e002f4738f12b1b89c1cd116e7d02a16edc497252c75cef2834aa4db50831e52"
Jul 28 01:56:45.221527 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:45.221494    2552 generic.go:356] "Generic (PLEG): container finished" podID="8e67ab15-644b-435f-b792-843ac18d4227" containerID="85e88097c788b68d92107914f89398805c0d8b5a3ed071336638990b5d368c23" exitCode=0
Jul 28 01:56:45.221949 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:45.221578    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529704496" event={"ID":"8e67ab15-644b-435f-b792-843ac18d4227","Type":"ContainerDied","Data":"85e88097c788b68d92107914f89398805c0d8b5a3ed071336638990b5d368c23"}
Jul 28 01:56:46.366210 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.366187    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529704496"
Jul 28 01:56:46.385698 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.385669    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7347-140510529704496_8e67ab15-644b-435f-b792-843ac18d4227/test-curl-7347-140510529704496/0.log"
Jul 28 01:56:46.409207 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.409171    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7347-140510529704496"]
Jul 28 01:56:46.411844 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.411821    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7347-140510529704496"]
Jul 28 01:56:46.434203 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.434165    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rngmc\" (UniqueName: \"kubernetes.io/projected/8e67ab15-644b-435f-b792-843ac18d4227-kube-api-access-rngmc\") pod \"8e67ab15-644b-435f-b792-843ac18d4227\" (UID: \"8e67ab15-644b-435f-b792-843ac18d4227\") "
Jul 28 01:56:46.436373 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.436337    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e67ab15-644b-435f-b792-843ac18d4227-kube-api-access-rngmc" (OuterVolumeSpecName: "kube-api-access-rngmc") pod "8e67ab15-644b-435f-b792-843ac18d4227" (UID: "8e67ab15-644b-435f-b792-843ac18d4227"). InnerVolumeSpecName "kube-api-access-rngmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:46.535591 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.535505    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rngmc\" (UniqueName: \"kubernetes.io/projected/8e67ab15-644b-435f-b792-843ac18d4227-kube-api-access-rngmc\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:56:46.564163 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.564116    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7347-140510529652752"]
Jul 28 01:56:46.564568 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.564553    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e67ab15-644b-435f-b792-843ac18d4227" containerName="test-curl-7347-140510529704496"
Jul 28 01:56:46.564618 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.564569    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e67ab15-644b-435f-b792-843ac18d4227" containerName="test-curl-7347-140510529704496"
Jul 28 01:56:46.564654 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.564649    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e67ab15-644b-435f-b792-843ac18d4227" containerName="test-curl-7347-140510529704496"
Jul 28 01:56:46.566916 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.566898    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:46.573677 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.573648    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529652752"]
Jul 28 01:56:46.636812 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.636775    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwk4k\" (UniqueName: \"kubernetes.io/projected/0803c1e2-eae6-41e5-8777-251ef41ffa34-kube-api-access-mwk4k\") pod \"test-curl-7347-140510529652752\" (UID: \"0803c1e2-eae6-41e5-8777-251ef41ffa34\") " pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:46.737885 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.737842    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwk4k\" (UniqueName: \"kubernetes.io/projected/0803c1e2-eae6-41e5-8777-251ef41ffa34-kube-api-access-mwk4k\") pod \"test-curl-7347-140510529652752\" (UID: \"0803c1e2-eae6-41e5-8777-251ef41ffa34\") " pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:46.746335 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.746298    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwk4k\" (UniqueName: \"kubernetes.io/projected/0803c1e2-eae6-41e5-8777-251ef41ffa34-kube-api-access-mwk4k\") pod \"test-curl-7347-140510529652752\" (UID: \"0803c1e2-eae6-41e5-8777-251ef41ffa34\") " pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:46.878457 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:46.878357    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:47.028471 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:47.028438    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529652752"]
Jul 28 01:56:47.029364 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:56:47.029334    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0803c1e2_eae6_41e5_8777_251ef41ffa34.slice/crio-a67e415cd97bfca7558cc77aa61d50e3eeaa931966ea5ee7d276c516c8fbfc4f WatchSource:0}: Error finding container a67e415cd97bfca7558cc77aa61d50e3eeaa931966ea5ee7d276c516c8fbfc4f: Status 404 returned error can't find the container with id a67e415cd97bfca7558cc77aa61d50e3eeaa931966ea5ee7d276c516c8fbfc4f
Jul 28 01:56:47.234502 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:47.234461    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529652752" event={"ID":"0803c1e2-eae6-41e5-8777-251ef41ffa34","Type":"ContainerStarted","Data":"a67e415cd97bfca7558cc77aa61d50e3eeaa931966ea5ee7d276c516c8fbfc4f"}
Jul 28 01:56:47.235815 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:47.235793    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e73e5b4ddc54fb6de5b4704250b7fc3b9f6bacaa1725d77c23029f1c0a220ead"
Jul 28 01:56:47.235815 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:47.235796    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529704496"
Jul 28 01:56:47.246330 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:56:47.246299    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7347-140510529704496\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="8e67ab15-644b-435f-b792-843ac18d4227" pod="opendatahub/test-curl-7347-140510529704496"
Jul 28 01:56:48.026437 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:56:48.026385    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7347-140510529704496\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="8e67ab15-644b-435f-b792-843ac18d4227" pod="opendatahub/test-curl-7347-140510529704496"
Jul 28 01:56:48.030148 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:48.030107    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e67ab15-644b-435f-b792-843ac18d4227" path="/var/lib/kubelet/pods/8e67ab15-644b-435f-b792-843ac18d4227/volumes"
Jul 28 01:56:48.244407 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:48.244369    2552 generic.go:356] "Generic (PLEG): container finished" podID="0803c1e2-eae6-41e5-8777-251ef41ffa34" containerID="97b83cd2989bab3e2a3cf050e5aeebc76cc589bda64c1d0576e4321f5bb22432" exitCode=0
Jul 28 01:56:48.244590 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:48.244458    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529652752" event={"ID":"0803c1e2-eae6-41e5-8777-251ef41ffa34","Type":"ContainerDied","Data":"97b83cd2989bab3e2a3cf050e5aeebc76cc589bda64c1d0576e4321f5bb22432"}
Jul 28 01:56:49.390235 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.390214    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:49.409639 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.409615    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7347-140510529652752_0803c1e2-eae6-41e5-8777-251ef41ffa34/test-curl-7347-140510529652752/0.log"
Jul 28 01:56:49.430983 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.430957    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7347-140510529652752"]
Jul 28 01:56:49.434487 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.434466    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7347-140510529652752"]
Jul 28 01:56:49.456146 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.456113    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwk4k\" (UniqueName: \"kubernetes.io/projected/0803c1e2-eae6-41e5-8777-251ef41ffa34-kube-api-access-mwk4k\") pod \"0803c1e2-eae6-41e5-8777-251ef41ffa34\" (UID: \"0803c1e2-eae6-41e5-8777-251ef41ffa34\") "
Jul 28 01:56:49.458263 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.458240    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0803c1e2-eae6-41e5-8777-251ef41ffa34-kube-api-access-mwk4k" (OuterVolumeSpecName: "kube-api-access-mwk4k") pod "0803c1e2-eae6-41e5-8777-251ef41ffa34" (UID: "0803c1e2-eae6-41e5-8777-251ef41ffa34"). InnerVolumeSpecName "kube-api-access-mwk4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:49.557649 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.557578    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwk4k\" (UniqueName: \"kubernetes.io/projected/0803c1e2-eae6-41e5-8777-251ef41ffa34-kube-api-access-mwk4k\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:56:49.567202 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.567179    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7347-140510529652752"]
Jul 28 01:56:49.567612 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.567600    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0803c1e2-eae6-41e5-8777-251ef41ffa34" containerName="test-curl-7347-140510529652752"
Jul 28 01:56:49.567652 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.567614    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0803c1e2-eae6-41e5-8777-251ef41ffa34" containerName="test-curl-7347-140510529652752"
Jul 28 01:56:49.567701 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.567692    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0803c1e2-eae6-41e5-8777-251ef41ffa34" containerName="test-curl-7347-140510529652752"
Jul 28 01:56:49.569763 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.569749    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:49.576660 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.576638    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529652752"]
Jul 28 01:56:49.658487 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.658453    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2rtt\" (UniqueName: \"kubernetes.io/projected/88bfd0dc-7fad-4a92-abd8-f79f5ad01331-kube-api-access-b2rtt\") pod \"test-curl-7347-140510529652752\" (UID: \"88bfd0dc-7fad-4a92-abd8-f79f5ad01331\") " pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:49.759677 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.759643    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2rtt\" (UniqueName: \"kubernetes.io/projected/88bfd0dc-7fad-4a92-abd8-f79f5ad01331-kube-api-access-b2rtt\") pod \"test-curl-7347-140510529652752\" (UID: \"88bfd0dc-7fad-4a92-abd8-f79f5ad01331\") " pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:49.770433 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.770410    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2rtt\" (UniqueName: \"kubernetes.io/projected/88bfd0dc-7fad-4a92-abd8-f79f5ad01331-kube-api-access-b2rtt\") pod \"test-curl-7347-140510529652752\" (UID: \"88bfd0dc-7fad-4a92-abd8-f79f5ad01331\") " pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:49.881086 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:49.881007    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:50.017166 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:56:50.017113    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88bfd0dc_7fad_4a92_abd8_f79f5ad01331.slice/crio-c02ea8ef40bd6cc99928935ecb256109e74455a5fd7b5eca4e337020f281dfb9 WatchSource:0}: Error finding container c02ea8ef40bd6cc99928935ecb256109e74455a5fd7b5eca4e337020f281dfb9: Status 404 returned error can't find the container with id c02ea8ef40bd6cc99928935ecb256109e74455a5fd7b5eca4e337020f281dfb9
Jul 28 01:56:50.022151 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:50.022109    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0803c1e2-eae6-41e5-8777-251ef41ffa34" path="/var/lib/kubelet/pods/0803c1e2-eae6-41e5-8777-251ef41ffa34/volumes"
Jul 28 01:56:50.022480 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:50.022463    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529652752"]
Jul 28 01:56:50.259297 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:50.259267    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:50.259297 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:50.259282    2552 scope.go:117] "RemoveContainer" containerID="97b83cd2989bab3e2a3cf050e5aeebc76cc589bda64c1d0576e4321f5bb22432"
Jul 28 01:56:50.260673 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:50.260427    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529652752" event={"ID":"88bfd0dc-7fad-4a92-abd8-f79f5ad01331","Type":"ContainerStarted","Data":"c02ea8ef40bd6cc99928935ecb256109e74455a5fd7b5eca4e337020f281dfb9"}
Jul 28 01:56:50.420211 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:50.420179    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:50.474762 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:50.474732    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:51.268530 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:51.268495    2552 generic.go:356] "Generic (PLEG): container finished" podID="88bfd0dc-7fad-4a92-abd8-f79f5ad01331" containerID="e489957a54fc2732d8b4381a0b3e613d9d953152a41d61f5edcc3ff7a06f9a64" exitCode=0
Jul 28 01:56:51.268734 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:51.268583    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529652752" event={"ID":"88bfd0dc-7fad-4a92-abd8-f79f5ad01331","Type":"ContainerDied","Data":"e489957a54fc2732d8b4381a0b3e613d9d953152a41d61f5edcc3ff7a06f9a64"}
Jul 28 01:56:52.419307 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.419283    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:52.439693 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.439655    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7347-140510529652752_88bfd0dc-7fad-4a92-abd8-f79f5ad01331/test-curl-7347-140510529652752/0.log"
Jul 28 01:56:52.462532 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.462186    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7347-140510529652752"]
Jul 28 01:56:52.468356 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.468322    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7347-140510529652752"]
Jul 28 01:56:52.483850 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.483820    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2rtt\" (UniqueName: \"kubernetes.io/projected/88bfd0dc-7fad-4a92-abd8-f79f5ad01331-kube-api-access-b2rtt\") pod \"88bfd0dc-7fad-4a92-abd8-f79f5ad01331\" (UID: \"88bfd0dc-7fad-4a92-abd8-f79f5ad01331\") "
Jul 28 01:56:52.486165 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.486117    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88bfd0dc-7fad-4a92-abd8-f79f5ad01331-kube-api-access-b2rtt" (OuterVolumeSpecName: "kube-api-access-b2rtt") pod "88bfd0dc-7fad-4a92-abd8-f79f5ad01331" (UID: "88bfd0dc-7fad-4a92-abd8-f79f5ad01331"). InnerVolumeSpecName "kube-api-access-b2rtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:52.585099 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.585008    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2rtt\" (UniqueName: \"kubernetes.io/projected/88bfd0dc-7fad-4a92-abd8-f79f5ad01331-kube-api-access-b2rtt\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:56:52.586293 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.586269    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7347-140510529653760"]
Jul 28 01:56:52.586951 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.586928    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88bfd0dc-7fad-4a92-abd8-f79f5ad01331" containerName="test-curl-7347-140510529652752"
Jul 28 01:56:52.586997 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.586958    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="88bfd0dc-7fad-4a92-abd8-f79f5ad01331" containerName="test-curl-7347-140510529652752"
Jul 28 01:56:52.587086 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.587073    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="88bfd0dc-7fad-4a92-abd8-f79f5ad01331" containerName="test-curl-7347-140510529652752"
Jul 28 01:56:52.589510 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.589495    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:52.598154 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.598096    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529653760"]
Jul 28 01:56:52.685782 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.685746    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj8s8\" (UniqueName: \"kubernetes.io/projected/e513e8de-c126-4e57-81cf-76133c3ce9a7-kube-api-access-kj8s8\") pod \"test-curl-7347-140510529653760\" (UID: \"e513e8de-c126-4e57-81cf-76133c3ce9a7\") " pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:52.786994 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.786951    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj8s8\" (UniqueName: \"kubernetes.io/projected/e513e8de-c126-4e57-81cf-76133c3ce9a7-kube-api-access-kj8s8\") pod \"test-curl-7347-140510529653760\" (UID: \"e513e8de-c126-4e57-81cf-76133c3ce9a7\") " pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:52.796327 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.796300    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj8s8\" (UniqueName: \"kubernetes.io/projected/e513e8de-c126-4e57-81cf-76133c3ce9a7-kube-api-access-kj8s8\") pod \"test-curl-7347-140510529653760\" (UID: \"e513e8de-c126-4e57-81cf-76133c3ce9a7\") " pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:52.900361 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:52.900327    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:53.036043 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:53.036012    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529653760"]
Jul 28 01:56:53.037473 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:56:53.037446    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode513e8de_c126_4e57_81cf_76133c3ce9a7.slice/crio-46e8a4a8a4b9f5ff1e4354c365a46a72ffca9579214b7ade0dc63640d0c5cb9f WatchSource:0}: Error finding container 46e8a4a8a4b9f5ff1e4354c365a46a72ffca9579214b7ade0dc63640d0c5cb9f: Status 404 returned error can't find the container with id 46e8a4a8a4b9f5ff1e4354c365a46a72ffca9579214b7ade0dc63640d0c5cb9f
Jul 28 01:56:53.284459 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:53.284376    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c02ea8ef40bd6cc99928935ecb256109e74455a5fd7b5eca4e337020f281dfb9"
Jul 28 01:56:53.284459 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:53.284385    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:53.285540 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:53.285517    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529653760" event={"ID":"e513e8de-c126-4e57-81cf-76133c3ce9a7","Type":"ContainerStarted","Data":"46e8a4a8a4b9f5ff1e4354c365a46a72ffca9579214b7ade0dc63640d0c5cb9f"}
Jul 28 01:56:53.295165 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:56:53.295108    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7347-140510529652752\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="88bfd0dc-7fad-4a92-abd8-f79f5ad01331" pod="opendatahub/test-curl-7347-140510529652752"
Jul 28 01:56:54.024073 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:54.024040    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88bfd0dc-7fad-4a92-abd8-f79f5ad01331" path="/var/lib/kubelet/pods/88bfd0dc-7fad-4a92-abd8-f79f5ad01331/volumes"
Jul 28 01:56:54.293022 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:54.292937    2552 generic.go:356] "Generic (PLEG): container finished" podID="e513e8de-c126-4e57-81cf-76133c3ce9a7" containerID="6ac77a7e284ae07cd372d73eed044d1fee31aaeb313e67d6f60eb24a674b93a4" exitCode=0
Jul 28 01:56:54.293210 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:54.293027    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529653760" event={"ID":"e513e8de-c126-4e57-81cf-76133c3ce9a7","Type":"ContainerDied","Data":"6ac77a7e284ae07cd372d73eed044d1fee31aaeb313e67d6f60eb24a674b93a4"}
Jul 28 01:56:55.440592 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.440564    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:55.464744 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.464719    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7347-140510529653760_e513e8de-c126-4e57-81cf-76133c3ce9a7/test-curl-7347-140510529653760/0.log"
Jul 28 01:56:55.490757 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.490723    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7347-140510529653760"]
Jul 28 01:56:55.495258 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.495232    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7347-140510529653760"]
Jul 28 01:56:55.512510 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.512479    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj8s8\" (UniqueName: \"kubernetes.io/projected/e513e8de-c126-4e57-81cf-76133c3ce9a7-kube-api-access-kj8s8\") pod \"e513e8de-c126-4e57-81cf-76133c3ce9a7\" (UID: \"e513e8de-c126-4e57-81cf-76133c3ce9a7\") "
Jul 28 01:56:55.514671 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.514639    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e513e8de-c126-4e57-81cf-76133c3ce9a7-kube-api-access-kj8s8" (OuterVolumeSpecName: "kube-api-access-kj8s8") pod "e513e8de-c126-4e57-81cf-76133c3ce9a7" (UID: "e513e8de-c126-4e57-81cf-76133c3ce9a7"). InnerVolumeSpecName "kube-api-access-kj8s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:55.612426 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.612329    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7347-140510529653760"]
Jul 28 01:56:55.612874 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.612855    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e513e8de-c126-4e57-81cf-76133c3ce9a7" containerName="test-curl-7347-140510529653760"
Jul 28 01:56:55.612983 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.612875    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="e513e8de-c126-4e57-81cf-76133c3ce9a7" containerName="test-curl-7347-140510529653760"
Jul 28 01:56:55.613041 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.612995    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="e513e8de-c126-4e57-81cf-76133c3ce9a7" containerName="test-curl-7347-140510529653760"
Jul 28 01:56:55.613166 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.613106    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj8s8\" (UniqueName: \"kubernetes.io/projected/e513e8de-c126-4e57-81cf-76133c3ce9a7-kube-api-access-kj8s8\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:56:55.615399 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.615379    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:55.624818 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.624794    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529653760"]
Jul 28 01:56:55.713864 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.713819    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg22r\" (UniqueName: \"kubernetes.io/projected/09212058-22cb-4d5e-8fba-926f23522863-kube-api-access-tg22r\") pod \"test-curl-7347-140510529653760\" (UID: \"09212058-22cb-4d5e-8fba-926f23522863\") " pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:55.814991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.814954    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg22r\" (UniqueName: \"kubernetes.io/projected/09212058-22cb-4d5e-8fba-926f23522863-kube-api-access-tg22r\") pod \"test-curl-7347-140510529653760\" (UID: \"09212058-22cb-4d5e-8fba-926f23522863\") " pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:55.824796 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.824764    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg22r\" (UniqueName: \"kubernetes.io/projected/09212058-22cb-4d5e-8fba-926f23522863-kube-api-access-tg22r\") pod \"test-curl-7347-140510529653760\" (UID: \"09212058-22cb-4d5e-8fba-926f23522863\") " pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:55.925835 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:55.925797    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:56.025574 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:56.025541    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e513e8de-c126-4e57-81cf-76133c3ce9a7" path="/var/lib/kubelet/pods/e513e8de-c126-4e57-81cf-76133c3ce9a7/volumes"
Jul 28 01:56:56.070248 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:56.070222    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7347-140510529653760"]
Jul 28 01:56:56.070759 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:56:56.070735    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09212058_22cb_4d5e_8fba_926f23522863.slice/crio-2039ef20f1ef55b6f3d9fde7862b362750a4d50b832b43c8d3d869d2b1c818b5 WatchSource:0}: Error finding container 2039ef20f1ef55b6f3d9fde7862b362750a4d50b832b43c8d3d869d2b1c818b5: Status 404 returned error can't find the container with id 2039ef20f1ef55b6f3d9fde7862b362750a4d50b832b43c8d3d869d2b1c818b5
Jul 28 01:56:56.306289 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:56.306195    2552 scope.go:117] "RemoveContainer" containerID="6ac77a7e284ae07cd372d73eed044d1fee31aaeb313e67d6f60eb24a674b93a4"
Jul 28 01:56:56.306289 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:56.306197    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:56.307568 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:56.307469    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529653760" event={"ID":"09212058-22cb-4d5e-8fba-926f23522863","Type":"ContainerStarted","Data":"2039ef20f1ef55b6f3d9fde7862b362750a4d50b832b43c8d3d869d2b1c818b5"}
Jul 28 01:56:57.315998 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:57.315964    2552 generic.go:356] "Generic (PLEG): container finished" podID="09212058-22cb-4d5e-8fba-926f23522863" containerID="7de5412a06162ceb48906ed7a4da26a3aa0317524b879f6153567d396f140cf1" exitCode=0
Jul 28 01:56:57.316400 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:57.316007    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7347-140510529653760" event={"ID":"09212058-22cb-4d5e-8fba-926f23522863","Type":"ContainerDied","Data":"7de5412a06162ceb48906ed7a4da26a3aa0317524b879f6153567d396f140cf1"}
Jul 28 01:56:58.459248 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:58.459214    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:58.480989 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:58.480964    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7347-140510529653760_09212058-22cb-4d5e-8fba-926f23522863/test-curl-7347-140510529653760/0.log"
Jul 28 01:56:58.507839 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:58.507812    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7347-140510529653760"]
Jul 28 01:56:58.511582 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:58.511558    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7347-140510529653760"]
Jul 28 01:56:58.546024 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:58.546002    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg22r\" (UniqueName: \"kubernetes.io/projected/09212058-22cb-4d5e-8fba-926f23522863-kube-api-access-tg22r\") pod \"09212058-22cb-4d5e-8fba-926f23522863\" (UID: \"09212058-22cb-4d5e-8fba-926f23522863\") "
Jul 28 01:56:58.548197 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:58.548174    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09212058-22cb-4d5e-8fba-926f23522863-kube-api-access-tg22r" (OuterVolumeSpecName: "kube-api-access-tg22r") pod "09212058-22cb-4d5e-8fba-926f23522863" (UID: "09212058-22cb-4d5e-8fba-926f23522863"). InnerVolumeSpecName "kube-api-access-tg22r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:56:58.647218 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:58.647187    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg22r\" (UniqueName: \"kubernetes.io/projected/09212058-22cb-4d5e-8fba-926f23522863-kube-api-access-tg22r\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:56:59.001843 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.001758    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:59.302116 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.302032    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"]
Jul 28 01:56:59.302498 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.302485    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09212058-22cb-4d5e-8fba-926f23522863" containerName="test-curl-7347-140510529653760"
Jul 28 01:56:59.302539 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.302499    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="09212058-22cb-4d5e-8fba-926f23522863" containerName="test-curl-7347-140510529653760"
Jul 28 01:56:59.302571 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.302565    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="09212058-22cb-4d5e-8fba-926f23522863" containerName="test-curl-7347-140510529653760"
Jul 28 01:56:59.304864 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.304847    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.307246 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.307222    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-8a33ed-openshift-default-dockercfg-7tbdv\""
Jul 28 01:56:59.315647 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.315623    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:59.316636 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.316614    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"]
Jul 28 01:56:59.329918 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.329890    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:59.330066 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.329897    2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2039ef20f1ef55b6f3d9fde7862b362750a4d50b832b43c8d3d869d2b1c818b5"
Jul 28 01:56:59.340038 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:56:59.340010    2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7347-140510529653760\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="09212058-22cb-4d5e-8fba-926f23522863" pod="opendatahub/test-curl-7347-140510529653760"
Jul 28 01:56:59.353538 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.353513    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-token\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.353663 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.353550    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-certs\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.353663 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.353619    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-socket\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.353740 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.353722    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-podinfo\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.353798 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.353743    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-envoy\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.353798 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.353784    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2479\" (UniqueName: \"kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-kube-api-access-s2479\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.353886 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.353814    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b46608c-6cd9-4351-850c-d0c114a9843a-istiod-ca-cert\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.353886 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.353832    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-data\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.353886 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.353847    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-credential-socket\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.455397 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.455360    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-podinfo\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.455397 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.455399    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-envoy\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.455676 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.455445    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2479\" (UniqueName: \"kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-kube-api-access-s2479\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.455676 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.455469    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b46608c-6cd9-4351-850c-d0c114a9843a-istiod-ca-cert\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.455676 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.455488    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-data\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.455676 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.455530    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-credential-socket\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.455676 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.455572    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-token\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.455676 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.455601    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-certs\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.455676 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.455671    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-socket\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.456175 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.456091    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-data\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.456175 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.456109    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-certs\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.456356 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.456287    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-credential-socket\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.456422 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.456355    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-socket\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.456464 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.456444    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b46608c-6cd9-4351-850c-d0c114a9843a-istiod-ca-cert\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.458000 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.457981    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-envoy\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.458228 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.458212    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-podinfo\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.464100 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.464077    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-token\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.464762 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.464740    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2479\" (UniqueName: \"kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-kube-api-access-s2479\") pod \"e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") " pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.616176 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.616058    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:56:59.650618 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.650578    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:56:59.764551 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.764522    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"]
Jul 28 01:56:59.766035 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:56:59.766009    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b46608c_6cd9_4351_850c_d0c114a9843a.slice/crio-063abf508ced09da7d3c05351e2943ea7d770b612f6cf2f7b3397ba20331e06a WatchSource:0}: Error finding container 063abf508ced09da7d3c05351e2943ea7d770b612f6cf2f7b3397ba20331e06a: Status 404 returned error can't find the container with id 063abf508ced09da7d3c05351e2943ea7d770b612f6cf2f7b3397ba20331e06a
Jul 28 01:56:59.768717 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.768675    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:56:59.768792 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.768774    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:56:59.768849 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:56:59.768835    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:57:00.023036 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:00.022996    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09212058-22cb-4d5e-8fba-926f23522863" path="/var/lib/kubelet/pods/09212058-22cb-4d5e-8fba-926f23522863/volumes"
Jul 28 01:57:00.336801 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:00.336703    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" event={"ID":"6b46608c-6cd9-4351-850c-d0c114a9843a","Type":"ContainerStarted","Data":"71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e"}
Jul 28 01:57:00.336801 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:00.336776    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" event={"ID":"6b46608c-6cd9-4351-850c-d0c114a9843a","Type":"ContainerStarted","Data":"063abf508ced09da7d3c05351e2943ea7d770b612f6cf2f7b3397ba20331e06a"}
Jul 28 01:57:00.357581 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:00.357529    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" podStartSLOduration=1.357515406 podStartE2EDuration="1.357515406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:56:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:57:00.356297447 +0000 UTC m=+3152.970605519" watchObservedRunningTime="2026-07-28 01:57:00.357515406 +0000 UTC m=+3152.971823895"
Jul 28 01:57:00.616411 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:00.616312    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:57:00.621513 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:00.621485    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:57:01.342876 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:01.342843    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:57:01.343913 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:01.343894    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:57:02.262605 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:02.262564    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:02.360041 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:02.360012    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:02.456347 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:02.456250    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:02.656551 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:02.656514    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:02.948737 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:02.948710    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:03.044544 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:03.044504    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:17.385314 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:17.385273    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 01:57:17.385747 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:17.385351    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 01:57:19.456003 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:19.455964    2552 generic.go:356] "Generic (PLEG): container finished" podID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerID="71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e" exitCode=0
Jul 28 01:57:19.456680 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:19.456039    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" event={"ID":"6b46608c-6cd9-4351-850c-d0c114a9843a","Type":"ContainerDied","Data":"71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e"}
Jul 28 01:57:19.456680 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:19.456451    2552 scope.go:117] "RemoveContainer" containerID="71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e"
Jul 28 01:57:19.457510 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:19.457479    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:57:19.457566 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:19.457554    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:57:19.457606 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:19.457586    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:57:20.467182 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:20.467111    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" event={"ID":"6b46608c-6cd9-4351-850c-d0c114a9843a","Type":"ContainerStarted","Data":"4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2"}
Jul 28 01:57:20.616577 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:20.616536    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:57:20.616780 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:20.616758    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 28 01:57:20.616852 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:20.616825    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 28 01:57:21.616619 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:21.616579    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 28 01:57:21.617017 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:21.616638    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 28 01:57:22.616668 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:22.616630    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 28 01:57:22.617062 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:22.616720    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 28 01:57:23.617018 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:23.616974    2552 patch_prober.go:28] interesting pod/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Jul 28 01:57:23.617475 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:23.617034    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Jul 28 01:57:24.620812 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:24.620776    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:57:24.621263 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:24.621169    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:57:24.622054 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:24.622033    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 01:57:27.240172 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:27.240116    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:27.923571 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:27.923534    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:28.229890 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.229810    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"]
Jul 28 01:57:28.232673 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.232657    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.235718 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.235697    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-c430e4-openshift-default-dockercfg-22zpn\""
Jul 28 01:57:28.245803 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.245776    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"]
Jul 28 01:57:28.247293 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.247274    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnlqc\" (UniqueName: \"kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-kube-api-access-qnlqc\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.247386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.247311    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-data\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.247386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.247329    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-podinfo\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.247386 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.247346    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istiod-ca-cert\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.247497 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.247410    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-token\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.247497 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.247464    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-certs\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.247567 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.247538    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-credential-socket\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.247602 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.247575    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-socket\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.247637 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.247611    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-envoy\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.258682 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.258644    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:28.349851 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.349810    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnlqc\" (UniqueName: \"kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-kube-api-access-qnlqc\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.350333 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.350310    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-data\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.350459 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.350443    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-podinfo\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.350561 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.350545    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istiod-ca-cert\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.350749 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.350731    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-token\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.350924 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.350906    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-certs\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.351077 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.351059    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-credential-socket\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.351238 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.351220    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-socket\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.351338 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.351275    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-envoy\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.353154 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.352457    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-socket\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.353154 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.352483    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-credential-socket\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.353154 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.353067    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-data\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.353449 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.353430    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-certs\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.354265 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.354243    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istiod-ca-cert\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.355588 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.355545    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-envoy\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.357460 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.357440    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-podinfo\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.361202 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.361179    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-token\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.361291 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.361203    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnlqc\" (UniqueName: \"kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-kube-api-access-qnlqc\") pod \"e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") " pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.363603 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.363576    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:28.543512 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.543419    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:28.697429 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.697401    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"]
Jul 28 01:57:28.699521 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:57:28.699496    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd9eb97a_5680_46cc_b4b4_c24b37a3123c.slice/crio-79a8c11c7d54fce46a1cca0d705b9b5250c2fbd30851e573d0b6a6d894e48872 WatchSource:0}: Error finding container 79a8c11c7d54fce46a1cca0d705b9b5250c2fbd30851e573d0b6a6d894e48872: Status 404 returned error can't find the container with id 79a8c11c7d54fce46a1cca0d705b9b5250c2fbd30851e573d0b6a6d894e48872
Jul 28 01:57:28.702242 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.702204    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:57:28.702340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.702284    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:57:28.702340 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:28.702319    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:57:29.530114 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:29.530074    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" event={"ID":"fd9eb97a-5680-46cc-b4b4-c24b37a3123c","Type":"ContainerStarted","Data":"2246bf7c9ff54ae42d316711ab879be894a0256c8d2f37c091762425dd606a89"}
Jul 28 01:57:29.530531 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:29.530162    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" event={"ID":"fd9eb97a-5680-46cc-b4b4-c24b37a3123c","Type":"ContainerStarted","Data":"79a8c11c7d54fce46a1cca0d705b9b5250c2fbd30851e573d0b6a6d894e48872"}
Jul 28 01:57:29.544633 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:29.544595    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:29.549486 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:29.549466    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:29.554786 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:29.554744    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" podStartSLOduration=1.554731464 podStartE2EDuration="1.554731464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:57:29.554069247 +0000 UTC m=+3182.168377325" watchObservedRunningTime="2026-07-28 01:57:29.554731464 +0000 UTC m=+3182.169039535"
Jul 28 01:57:30.535751 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:30.535716    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:30.536713 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:30.536692    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:31.467223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:31.467188    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:31.564668 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:31.564628    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:31.855236 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:31.855123    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:32.428749 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:32.428705    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:32.528724 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:32.528679    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:32.616457 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:32.616422    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:46.212827 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:46.212789    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:57:49.650907 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:49.650872    2552 generic.go:356] "Generic (PLEG): container finished" podID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerID="2246bf7c9ff54ae42d316711ab879be894a0256c8d2f37c091762425dd606a89" exitCode=0
Jul 28 01:57:49.651325 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:49.650945    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" event={"ID":"fd9eb97a-5680-46cc-b4b4-c24b37a3123c","Type":"ContainerDied","Data":"2246bf7c9ff54ae42d316711ab879be894a0256c8d2f37c091762425dd606a89"}
Jul 28 01:57:49.651426 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:49.651413    2552 scope.go:117] "RemoveContainer" containerID="2246bf7c9ff54ae42d316711ab879be894a0256c8d2f37c091762425dd606a89"
Jul 28 01:57:49.652572 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:49.652543    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:57:49.652638 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:49.652614    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:57:49.652675 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:49.652646    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:57:50.659485 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:50.659450    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" event={"ID":"fd9eb97a-5680-46cc-b4b4-c24b37a3123c","Type":"ContainerStarted","Data":"e22f37112d502378afbd2b55fffe7d0a9bb3d2647578c467a6647068686e0487"}
Jul 28 01:57:51.544445 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:51.544406    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:51.544644 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:51.544613    2552 patch_prober.go:28] interesting pod/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Jul 28 01:57:51.544692 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:51.544665    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Jul 28 01:57:52.544330 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:52.544294    2552 patch_prober.go:28] interesting pod/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Jul 28 01:57:52.544729 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:52.544360    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Jul 28 01:57:53.043299 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:53.043269    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ps9zc_48e1355a-db6d-41a2-bb00-e6963d587e74/payload-processing/0.log"
Jul 28 01:57:53.544274 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:53.544236    2552 patch_prober.go:28] interesting pod/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Jul 28 01:57:53.544452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:53.544292    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Jul 28 01:57:54.544573 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:54.544533    2552 patch_prober.go:28] interesting pod/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Jul 28 01:57:54.544985 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:54.544613    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Jul 28 01:57:55.548311 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:55.548281    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:55.548734 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:55.548653    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:57:55.549334 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:57:55.549317    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 01:58:03.248515 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:03.248475    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:43.096885 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.096804    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ps9zc_48e1355a-db6d-41a2-bb00-e6963d587e74/payload-processing/0.log"
Jul 28 01:58:43.564541 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.564461    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:43.784646 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.784612    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"]
Jul 28 01:58:43.787513 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.787497    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.790108 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.790089    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-9e1b27-openshift-default-dockercfg-j662j\""
Jul 28 01:58:43.801855 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.801834    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"]
Jul 28 01:58:43.806232 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.806212    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:43.828613 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.828539    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-certs\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.828613 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.828574    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-istio-token\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.828613 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.828594    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgfpc\" (UniqueName: \"kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-kube-api-access-hgfpc\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.828819 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.828696    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-envoy\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.828819 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.828749    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-credential-socket\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.828819 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.828802    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-data\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.828949 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.828846    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557b8df0-cce9-4fe7-b878-b604db88087f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.828949 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.828882    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557b8df0-cce9-4fe7-b878-b604db88087f-istio-podinfo\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.828949 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.828920    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-socket\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.894200 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.894169    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:43.929509 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.929481    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-envoy\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.929700 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.929525    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-credential-socket\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.929700 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.929560    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-data\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.929700 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.929583    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557b8df0-cce9-4fe7-b878-b604db88087f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.929700 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.929618    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557b8df0-cce9-4fe7-b878-b604db88087f-istio-podinfo\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.929700 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.929650    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-socket\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.929991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.929708    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-certs\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.929991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.929737    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-istio-token\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.929991 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.929764    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgfpc\" (UniqueName: \"kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-kube-api-access-hgfpc\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.930223 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.930191    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-data\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.930346 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.930293    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-credential-socket\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.930346 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.930293    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-socket\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.930478 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.930395    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-certs\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.930567 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.930539    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557b8df0-cce9-4fe7-b878-b604db88087f-istiod-ca-cert\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.932657 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.932636    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-envoy\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.932791 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.932761    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557b8df0-cce9-4fe7-b878-b604db88087f-istio-podinfo\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.937789 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.937766    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-istio-token\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:43.938452 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:43.938433    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgfpc\" (UniqueName: \"kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-kube-api-access-hgfpc\") pod \"e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") " pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:44.098685 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:44.098571    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:44.246730 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:44.246699    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"]
Jul 28 01:58:44.248761 ip-10-0-137-121 kubenswrapper[2552]: W0728 01:58:44.248728    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557b8df0_cce9_4fe7_b878_b604db88087f.slice/crio-eadbe4013cb18d40eba98a8d0ab2f04e297ede9dcfe2d958ea55ffb5b4ff8d20 WatchSource:0}: Error finding container eadbe4013cb18d40eba98a8d0ab2f04e297ede9dcfe2d958ea55ffb5b4ff8d20: Status 404 returned error can't find the container with id eadbe4013cb18d40eba98a8d0ab2f04e297ede9dcfe2d958ea55ffb5b4ff8d20
Jul 28 01:58:44.251032 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:44.250999    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:58:44.251124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:44.251074    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:58:44.251124 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:44.251101    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:58:45.006882 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:45.006847    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" event={"ID":"557b8df0-cce9-4fe7-b878-b604db88087f","Type":"ContainerStarted","Data":"193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf"}
Jul 28 01:58:45.007045 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:45.006942    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" event={"ID":"557b8df0-cce9-4fe7-b878-b604db88087f","Type":"ContainerStarted","Data":"eadbe4013cb18d40eba98a8d0ab2f04e297ede9dcfe2d958ea55ffb5b4ff8d20"}
Jul 28 01:58:45.030747 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:45.030675    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" podStartSLOduration=2.030651883 podStartE2EDuration="2.030651883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:58:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:58:45.027833737 +0000 UTC m=+3257.642141832" watchObservedRunningTime="2026-07-28 01:58:45.030651883 +0000 UTC m=+3257.644959957"
Jul 28 01:58:45.098805 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:45.098767    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:45.104422 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:45.104392    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:46.013404 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:46.013372    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:46.014507 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:46.014488    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:58:46.969772 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:46.969735    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:47.076327 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:47.076292    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:49.052200 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:49.052155    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:49.431462 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:49.431429    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:49.533743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:49.533710    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:58:49.627633 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:58:49.627601    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:01.257994 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:01.257957    2552 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": read tcp 10.134.0.2:46864->10.134.0.77:15021: read: connection reset by peer" start-of-body=
Jul 28 01:59:01.258490 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:01.258029    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": read tcp 10.134.0.2:46864->10.134.0.77:15021: read: connection reset by peer"
Jul 28 01:59:01.658644 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:01.658614    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:02.126512 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:02.126430    2552 generic.go:356] "Generic (PLEG): container finished" podID="557b8df0-cce9-4fe7-b878-b604db88087f" containerID="193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf" exitCode=0
Jul 28 01:59:02.126662 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:02.126507    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" event={"ID":"557b8df0-cce9-4fe7-b878-b604db88087f","Type":"ContainerDied","Data":"193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf"}
Jul 28 01:59:02.126977 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:02.126963    2552 scope.go:117] "RemoveContainer" containerID="193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf"
Jul 28 01:59:02.128228 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:02.128202    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:59:02.128293 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:02.128273    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:59:02.128330 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:02.128306    2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 28 01:59:03.135125 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:03.135088    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" event={"ID":"557b8df0-cce9-4fe7-b878-b604db88087f","Type":"ContainerStarted","Data":"f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be"}
Jul 28 01:59:04.099244 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:04.099202    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:59:04.099502 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:04.099478    2552 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 28 01:59:04.099556 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:04.099531    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 28 01:59:05.099848 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:05.099813    2552 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 28 01:59:05.100353 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:05.099893    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 28 01:59:06.099761 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:06.099716    2552 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 28 01:59:06.099941 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:06.099792    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 28 01:59:07.099012 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:07.098971    2552 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 28 01:59:07.099233 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:07.099036    2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 28 01:59:08.103428 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:08.103397    2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:59:08.103875 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:08.103856    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:59:08.104596 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:08.104575    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:59:11.295783 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:11.295751    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:11.395938 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:11.395905    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:11.490581 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:11.490509    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:11.575924 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:11.575823    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:11.812743 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:11.812712    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:18.303835 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:18.303797    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:18.403829 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:18.403778    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:18.543099 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:18.543061    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"]
Jul 28 01:59:18.543370 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:18.543337    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy" containerID="cri-o://f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be" gracePeriod=30
Jul 28 01:59:18.586433 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:18.586341    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:18.859205 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:18.859109    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:23.106762 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.106715    2552 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 01:59:23.107179 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.106796    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 01:59:23.797662 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.797631    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:59:23.871716 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.871624    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557b8df0-cce9-4fe7-b878-b604db88087f-istio-podinfo\") pod \"557b8df0-cce9-4fe7-b878-b604db88087f\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") "
Jul 28 01:59:23.871716 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.871668    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgfpc\" (UniqueName: \"kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-kube-api-access-hgfpc\") pod \"557b8df0-cce9-4fe7-b878-b604db88087f\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") "
Jul 28 01:59:23.871716 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.871688    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-istio-token\") pod \"557b8df0-cce9-4fe7-b878-b604db88087f\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") "
Jul 28 01:59:23.871954 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.871761    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-socket\") pod \"557b8df0-cce9-4fe7-b878-b604db88087f\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") "
Jul 28 01:59:23.871954 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.871813    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-envoy\") pod \"557b8df0-cce9-4fe7-b878-b604db88087f\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") "
Jul 28 01:59:23.871954 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.871869    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-credential-socket\") pod \"557b8df0-cce9-4fe7-b878-b604db88087f\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") "
Jul 28 01:59:23.871954 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.871910    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-certs\") pod \"557b8df0-cce9-4fe7-b878-b604db88087f\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") "
Jul 28 01:59:23.872208 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.871956    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557b8df0-cce9-4fe7-b878-b604db88087f-istiod-ca-cert\") pod \"557b8df0-cce9-4fe7-b878-b604db88087f\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") "
Jul 28 01:59:23.872208 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.872014    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-data\") pod \"557b8df0-cce9-4fe7-b878-b604db88087f\" (UID: \"557b8df0-cce9-4fe7-b878-b604db88087f\") "
Jul 28 01:59:23.872208 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.872095    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "557b8df0-cce9-4fe7-b878-b604db88087f" (UID: "557b8df0-cce9-4fe7-b878-b604db88087f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:59:23.872397 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.872367    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "557b8df0-cce9-4fe7-b878-b604db88087f" (UID: "557b8df0-cce9-4fe7-b878-b604db88087f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:59:23.872554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.872457    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/557b8df0-cce9-4fe7-b878-b604db88087f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "557b8df0-cce9-4fe7-b878-b604db88087f" (UID: "557b8df0-cce9-4fe7-b878-b604db88087f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 01:59:23.872554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.872500    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:59:23.872554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.872522    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:59:23.872554 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.872522    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "557b8df0-cce9-4fe7-b878-b604db88087f" (UID: "557b8df0-cce9-4fe7-b878-b604db88087f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:59:23.873522 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.873498    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-data" (OuterVolumeSpecName: "istio-data") pod "557b8df0-cce9-4fe7-b878-b604db88087f" (UID: "557b8df0-cce9-4fe7-b878-b604db88087f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:59:23.874421 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.874390    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-istio-token" (OuterVolumeSpecName: "istio-token") pod "557b8df0-cce9-4fe7-b878-b604db88087f" (UID: "557b8df0-cce9-4fe7-b878-b604db88087f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:59:23.874421 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.874405    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-kube-api-access-hgfpc" (OuterVolumeSpecName: "kube-api-access-hgfpc") pod "557b8df0-cce9-4fe7-b878-b604db88087f" (UID: "557b8df0-cce9-4fe7-b878-b604db88087f"). InnerVolumeSpecName "kube-api-access-hgfpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 01:59:23.874631 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.874614    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/557b8df0-cce9-4fe7-b878-b604db88087f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "557b8df0-cce9-4fe7-b878-b604db88087f" (UID: "557b8df0-cce9-4fe7-b878-b604db88087f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 01:59:23.874697 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.874678    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "557b8df0-cce9-4fe7-b878-b604db88087f" (UID: "557b8df0-cce9-4fe7-b878-b604db88087f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 01:59:23.974108 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.974066    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:59:23.974108 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.974101    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/557b8df0-cce9-4fe7-b878-b604db88087f-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:59:23.974108 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.974115    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:59:23.974384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.974126    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/557b8df0-cce9-4fe7-b878-b604db88087f-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:59:23.974384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.974166    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgfpc\" (UniqueName: \"kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-kube-api-access-hgfpc\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:59:23.974384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.974179    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/557b8df0-cce9-4fe7-b878-b604db88087f-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:59:23.974384 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:23.974189    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/557b8df0-cce9-4fe7-b878-b604db88087f-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 01:59:24.272519 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.272484    2552 generic.go:356] "Generic (PLEG): container finished" podID="557b8df0-cce9-4fe7-b878-b604db88087f" containerID="f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be" exitCode=0
Jul 28 01:59:24.272914 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.272535    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"
Jul 28 01:59:24.272914 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.272570    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" event={"ID":"557b8df0-cce9-4fe7-b878-b604db88087f","Type":"ContainerDied","Data":"f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be"}
Jul 28 01:59:24.272914 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.272626    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9" event={"ID":"557b8df0-cce9-4fe7-b878-b604db88087f","Type":"ContainerDied","Data":"eadbe4013cb18d40eba98a8d0ab2f04e297ede9dcfe2d958ea55ffb5b4ff8d20"}
Jul 28 01:59:24.272914 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.272648    2552 scope.go:117] "RemoveContainer" containerID="f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be"
Jul 28 01:59:24.282400 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.282383    2552 scope.go:117] "RemoveContainer" containerID="193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf"
Jul 28 01:59:24.289839 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.289818    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"]
Jul 28 01:59:24.291373 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.291354    2552 scope.go:117] "RemoveContainer" containerID="f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be"
Jul 28 01:59:24.291640 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:59:24.291622    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be\": container with ID starting with f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be not found: ID does not exist" containerID="f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be"
Jul 28 01:59:24.291712 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.291652    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be"} err="failed to get container status \"f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be\": rpc error: code = NotFound desc = could not find container \"f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be\": container with ID starting with f801437f00ec9cf44e8a6b490f4a6c101ee69163c6ade8328bd5a1beea9959be not found: ID does not exist"
Jul 28 01:59:24.291712 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.291678    2552 scope.go:117] "RemoveContainer" containerID="193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf"
Jul 28 01:59:24.291958 ip-10-0-137-121 kubenswrapper[2552]: E0728 01:59:24.291930    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf\": container with ID starting with 193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf not found: ID does not exist" containerID="193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf"
Jul 28 01:59:24.292001 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.291964    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf"} err="failed to get container status \"193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf\": rpc error: code = NotFound desc = could not find container \"193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf\": container with ID starting with 193499a00197d048acf9f67df893f0c550867abe745361d89ea9fa9bb2cdf0bf not found: ID does not exist"
Jul 28 01:59:24.296549 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:24.296530    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-9e1b27-openshift-default-7bd6c8cd64-wpfm9"]
Jul 28 01:59:26.023285 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:26.023256    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" path="/var/lib/kubelet/pods/557b8df0-cce9-4fe7-b878-b604db88087f/volumes"
Jul 28 01:59:36.483784 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:36.483742    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:36.587449 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:36.587416    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:36.691932 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:36.691892    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:36.785002 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:36.784915    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:37.104399 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:37.104311    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:42.167432 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:42.167388    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:46.883350 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:46.883311    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:46.983400 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:46.983360    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 01:59:52.033633 ip-10-0-137-121 kubenswrapper[2552]: I0728 01:59:52.033553    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:18.730505 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:18.730469    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:19.639976 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:19.639934    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:20.326723 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:20.326692    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:25.284801 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:25.284766    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:40.054368 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:40.054332    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:40.152029 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:40.151995    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:40.333515 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:40.333415    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"]
Jul 28 02:00:40.333752 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:40.333627    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy" containerID="cri-o://4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2" gracePeriod=30
Jul 28 02:00:40.353769 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:40.353734    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:40.582695 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:40.582659    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:45.601645 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.601577    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 02:00:45.696741 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.696708    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-credential-socket\") pod \"6b46608c-6cd9-4351-850c-d0c114a9843a\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") "
Jul 28 02:00:45.696741 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.696756    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2479\" (UniqueName: \"kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-kube-api-access-s2479\") pod \"6b46608c-6cd9-4351-850c-d0c114a9843a\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") "
Jul 28 02:00:45.697027 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.696792    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-data\") pod \"6b46608c-6cd9-4351-850c-d0c114a9843a\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") "
Jul 28 02:00:45.697027 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.696820    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-socket\") pod \"6b46608c-6cd9-4351-850c-d0c114a9843a\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") "
Jul 28 02:00:45.697027 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.696863    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-certs\") pod \"6b46608c-6cd9-4351-850c-d0c114a9843a\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") "
Jul 28 02:00:45.697027 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.696959    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-envoy\") pod \"6b46608c-6cd9-4351-850c-d0c114a9843a\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") "
Jul 28 02:00:45.697027 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.696994    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b46608c-6cd9-4351-850c-d0c114a9843a-istiod-ca-cert\") pod \"6b46608c-6cd9-4351-850c-d0c114a9843a\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") "
Jul 28 02:00:45.697317 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.697036    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-token\") pod \"6b46608c-6cd9-4351-850c-d0c114a9843a\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") "
Jul 28 02:00:45.697317 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.697102    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-podinfo\") pod \"6b46608c-6cd9-4351-850c-d0c114a9843a\" (UID: \"6b46608c-6cd9-4351-850c-d0c114a9843a\") "
Jul 28 02:00:45.697317 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.697081    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b46608c-6cd9-4351-850c-d0c114a9843a" (UID: "6b46608c-6cd9-4351-850c-d0c114a9843a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:00:45.697317 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.697122    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b46608c-6cd9-4351-850c-d0c114a9843a" (UID: "6b46608c-6cd9-4351-850c-d0c114a9843a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:00:45.697317 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.697182    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b46608c-6cd9-4351-850c-d0c114a9843a" (UID: "6b46608c-6cd9-4351-850c-d0c114a9843a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:00:45.697554 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.697465    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b46608c-6cd9-4351-850c-d0c114a9843a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b46608c-6cd9-4351-850c-d0c114a9843a" (UID: "6b46608c-6cd9-4351-850c-d0c114a9843a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:00:45.697554 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.697489    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:00:45.697554 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.697510    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:00:45.697554 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.697524    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:00:45.698488 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.698459    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b46608c-6cd9-4351-850c-d0c114a9843a" (UID: "6b46608c-6cd9-4351-850c-d0c114a9843a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:00:45.699416 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.699383    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b46608c-6cd9-4351-850c-d0c114a9843a" (UID: "6b46608c-6cd9-4351-850c-d0c114a9843a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:00:45.699416 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.699411    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-kube-api-access-s2479" (OuterVolumeSpecName: "kube-api-access-s2479") pod "6b46608c-6cd9-4351-850c-d0c114a9843a" (UID: "6b46608c-6cd9-4351-850c-d0c114a9843a"). InnerVolumeSpecName "kube-api-access-s2479". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:00:45.699687 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.699665    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b46608c-6cd9-4351-850c-d0c114a9843a" (UID: "6b46608c-6cd9-4351-850c-d0c114a9843a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 02:00:45.699784 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.699768    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b46608c-6cd9-4351-850c-d0c114a9843a" (UID: "6b46608c-6cd9-4351-850c-d0c114a9843a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:00:45.777029 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.776987    2552 generic.go:356] "Generic (PLEG): container finished" podID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerID="4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2" exitCode=0
Jul 28 02:00:45.777029 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.777017    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"
Jul 28 02:00:45.777333 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.777054    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" event={"ID":"6b46608c-6cd9-4351-850c-d0c114a9843a","Type":"ContainerDied","Data":"4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2"}
Jul 28 02:00:45.777333 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.777167    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw" event={"ID":"6b46608c-6cd9-4351-850c-d0c114a9843a","Type":"ContainerDied","Data":"063abf508ced09da7d3c05351e2943ea7d770b612f6cf2f7b3397ba20331e06a"}
Jul 28 02:00:45.777333 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.777202    2552 scope.go:117] "RemoveContainer" containerID="4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2"
Jul 28 02:00:45.788104 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.788084    2552 scope.go:117] "RemoveContainer" containerID="71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e"
Jul 28 02:00:45.798247 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.798034    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:00:45.798247 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.798063    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:00:45.798247 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.798077    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2479\" (UniqueName: \"kubernetes.io/projected/6b46608c-6cd9-4351-850c-d0c114a9843a-kube-api-access-s2479\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:00:45.798247 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.798091    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:00:45.798247 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.798105    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b46608c-6cd9-4351-850c-d0c114a9843a-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:00:45.798247 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.798117    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b46608c-6cd9-4351-850c-d0c114a9843a-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:00:45.798557 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.798351    2552 scope.go:117] "RemoveContainer" containerID="4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2"
Jul 28 02:00:45.798756 ip-10-0-137-121 kubenswrapper[2552]: E0728 02:00:45.798732    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2\": container with ID starting with 4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2 not found: ID does not exist" containerID="4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2"
Jul 28 02:00:45.798811 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.798771    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2"} err="failed to get container status \"4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2\": rpc error: code = NotFound desc = could not find container \"4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2\": container with ID starting with 4b32d4ea7ffd2e5874113c0cc38b11d957237cf10a10e3139ff4567fd2f560c2 not found: ID does not exist"
Jul 28 02:00:45.798811 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.798795    2552 scope.go:117] "RemoveContainer" containerID="71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e"
Jul 28 02:00:45.799084 ip-10-0-137-121 kubenswrapper[2552]: E0728 02:00:45.799068    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e\": container with ID starting with 71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e not found: ID does not exist" containerID="71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e"
Jul 28 02:00:45.799149 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.799088    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e"} err="failed to get container status \"71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e\": rpc error: code = NotFound desc = could not find container \"71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e\": container with ID starting with 71a545c5bb23cf2c1b5bc8dd9a981b3b8c17027ac672bc29c16d54fd39544e8e not found: ID does not exist"
Jul 28 02:00:45.799960 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.799940    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"]
Jul 28 02:00:45.806302 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:45.806269    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-8a33ed-openshift-default-75dc9657db-z2czw"]
Jul 28 02:00:46.022980 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:46.022950    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" path="/var/lib/kubelet/pods/6b46608c-6cd9-4351-850c-d0c114a9843a/volumes"
Jul 28 02:00:47.657320 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:47.657286    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:47.762125 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:47.762079    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:47.861494 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:47.861443    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:47.962596 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:47.962498    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:48.230769 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:48.230683    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:54.473774 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:54.473739    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:54.733371 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:54.733286    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"]
Jul 28 02:00:54.733563 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:54.733536    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy" containerID="cri-o://e22f37112d502378afbd2b55fffe7d0a9bb3d2647578c467a6647068686e0487" gracePeriod=30
Jul 28 02:00:54.749797 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:54.749765    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:54.849685 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:54.849626    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:54.989275 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:54.989187    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:00:55.551510 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:55.551478    2552 patch_prober.go:28] interesting pod/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 02:00:55.551918 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:55.551532    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 02:00:59.865946 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:59.865911    2552 generic.go:356] "Generic (PLEG): container finished" podID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerID="e22f37112d502378afbd2b55fffe7d0a9bb3d2647578c467a6647068686e0487" exitCode=0
Jul 28 02:00:59.866426 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:59.865985    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" event={"ID":"fd9eb97a-5680-46cc-b4b4-c24b37a3123c","Type":"ContainerDied","Data":"e22f37112d502378afbd2b55fffe7d0a9bb3d2647578c467a6647068686e0487"}
Jul 28 02:00:59.866426 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:59.866064    2552 scope.go:117] "RemoveContainer" containerID="2246bf7c9ff54ae42d316711ab879be894a0256c8d2f37c091762425dd606a89"
Jul 28 02:00:59.947510 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:00:59.947473    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:00.026522 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.026492    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:00.030104 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.030080    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 02:01:00.047545 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047519    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-credential-socket\") pod \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") "
Jul 28 02:01:00.047681 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047550    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-socket\") pod \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") "
Jul 28 02:01:00.047681 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047568    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-envoy\") pod \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") "
Jul 28 02:01:00.047681 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047613    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-data\") pod \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") "
Jul 28 02:01:00.047681 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047649    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-podinfo\") pod \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") "
Jul 28 02:01:00.047881 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047691    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnlqc\" (UniqueName: \"kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-kube-api-access-qnlqc\") pod \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") "
Jul 28 02:01:00.047881 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047715    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istiod-ca-cert\") pod \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") "
Jul 28 02:01:00.047881 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047748    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-certs\") pod \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") "
Jul 28 02:01:00.047881 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047782    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-token\") pod \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\" (UID: \"fd9eb97a-5680-46cc-b4b4-c24b37a3123c\") "
Jul 28 02:01:00.047881 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047810    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd9eb97a-5680-46cc-b4b4-c24b37a3123c" (UID: "fd9eb97a-5680-46cc-b4b4-c24b37a3123c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:00.048217 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.047901    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd9eb97a-5680-46cc-b4b4-c24b37a3123c" (UID: "fd9eb97a-5680-46cc-b4b4-c24b37a3123c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:00.048217 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.048038    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd9eb97a-5680-46cc-b4b4-c24b37a3123c" (UID: "fd9eb97a-5680-46cc-b4b4-c24b37a3123c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:00.048328 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.048307    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:00.048380 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.048327    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:00.048380 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.048340    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:00.048482 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.048367    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd9eb97a-5680-46cc-b4b4-c24b37a3123c" (UID: "fd9eb97a-5680-46cc-b4b4-c24b37a3123c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:01:00.048723 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.048699    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd9eb97a-5680-46cc-b4b4-c24b37a3123c" (UID: "fd9eb97a-5680-46cc-b4b4-c24b37a3123c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:00.050536 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.050513    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd9eb97a-5680-46cc-b4b4-c24b37a3123c" (UID: "fd9eb97a-5680-46cc-b4b4-c24b37a3123c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 02:01:00.050658 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.050614    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd9eb97a-5680-46cc-b4b4-c24b37a3123c" (UID: "fd9eb97a-5680-46cc-b4b4-c24b37a3123c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:00.050900 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.050876    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-kube-api-access-qnlqc" (OuterVolumeSpecName: "kube-api-access-qnlqc") pod "fd9eb97a-5680-46cc-b4b4-c24b37a3123c" (UID: "fd9eb97a-5680-46cc-b4b4-c24b37a3123c"). InnerVolumeSpecName "kube-api-access-qnlqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:01:00.051284 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.051269    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd9eb97a-5680-46cc-b4b4-c24b37a3123c" (UID: "fd9eb97a-5680-46cc-b4b4-c24b37a3123c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:01:00.125783 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.125745    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:00.149176 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.149123    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:00.149176 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.149173    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:00.149176 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.149182    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:00.149388 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.149190    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:00.149388 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.149204    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnlqc\" (UniqueName: \"kubernetes.io/projected/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-kube-api-access-qnlqc\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:00.149388 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.149218    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd9eb97a-5680-46cc-b4b4-c24b37a3123c-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:00.202701 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.202665    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:00.513807 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.513772    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:00.873646 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.873555    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"
Jul 28 02:01:00.873646 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.873578    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457" event={"ID":"fd9eb97a-5680-46cc-b4b4-c24b37a3123c","Type":"ContainerDied","Data":"79a8c11c7d54fce46a1cca0d705b9b5250c2fbd30851e573d0b6a6d894e48872"}
Jul 28 02:01:00.873646 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.873641    2552 scope.go:117] "RemoveContainer" containerID="e22f37112d502378afbd2b55fffe7d0a9bb3d2647578c467a6647068686e0487"
Jul 28 02:01:00.898699 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.898667    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"]
Jul 28 02:01:00.911855 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:00.911829    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-c430e4-openshift-default-7b795f85d6-gt457"]
Jul 28 02:01:02.023504 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:02.023382    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" path="/var/lib/kubelet/pods/fd9eb97a-5680-46cc-b4b4-c24b37a3123c/volumes"
Jul 28 02:01:06.623934 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:06.623899    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:06.695599 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:06.695527    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:06.851532 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:06.851499    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"]
Jul 28 02:01:06.851742 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:06.851718    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy" containerID="cri-o://61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e" gracePeriod=30
Jul 28 02:01:06.879348 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:06.879268    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:07.091998 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:07.091951    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:09.668124 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:09.668084    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:10.560673 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:10.560621    2552 patch_prober.go:28] interesting pod/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 02:01:10.560993 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:10.560721    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 02:01:12.107806 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.107780    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 02:01:12.167031 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.166992    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-credential-socket\") pod \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") "
Jul 28 02:01:12.167258 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167045    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-podinfo\") pod \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") "
Jul 28 02:01:12.167258 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167065    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-token\") pod \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") "
Jul 28 02:01:12.167258 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167097    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istiod-ca-cert\") pod \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") "
Jul 28 02:01:12.167258 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167220    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hss4\" (UniqueName: \"kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-kube-api-access-9hss4\") pod \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") "
Jul 28 02:01:12.167487 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167281    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-envoy\") pod \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") "
Jul 28 02:01:12.167487 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167377    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-socket\") pod \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") "
Jul 28 02:01:12.167487 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167405    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-certs\") pod \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") "
Jul 28 02:01:12.167487 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167410    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" (UID: "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:12.167487 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167478    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-data\") pod \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\" (UID: \"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363\") "
Jul 28 02:01:12.167730 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167498    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" (UID: "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:01:12.167730 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167637    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" (UID: "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:12.167833 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167778    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" (UID: "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:12.167833 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167810    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:12.167939 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167845    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:12.167939 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.167867    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:12.168652 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.168629    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-data" (OuterVolumeSpecName: "istio-data") pod "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" (UID: "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:12.169588 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.169557    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" (UID: "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 02:01:12.169588 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.169573    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" (UID: "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:12.169931 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.169909    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-kube-api-access-9hss4" (OuterVolumeSpecName: "kube-api-access-9hss4") pod "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" (UID: "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363"). InnerVolumeSpecName "kube-api-access-9hss4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:01:12.169931 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.169921    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-token" (OuterVolumeSpecName: "istio-token") pod "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" (UID: "ad076bb7-da7c-4ff2-a3f9-f9572fb3f363"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:01:12.268547 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.268511    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hss4\" (UniqueName: \"kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-kube-api-access-9hss4\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:12.268547 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.268544    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:12.268547 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.268554    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:12.268547 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.268561    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:12.268547 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.268569    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:12.268887 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.268577    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:12.948082 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.948049    2552 generic.go:356] "Generic (PLEG): container finished" podID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerID="61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e" exitCode=0
Jul 28 02:01:12.948285 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.948097    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"
Jul 28 02:01:12.948285 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.948149    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" event={"ID":"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363","Type":"ContainerDied","Data":"61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e"}
Jul 28 02:01:12.948285 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.948211    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p" event={"ID":"ad076bb7-da7c-4ff2-a3f9-f9572fb3f363","Type":"ContainerDied","Data":"25abadd6b948335803aac8031ed0e7f13791baab9fac62dea7a09a026ebe95ae"}
Jul 28 02:01:12.948285 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.948235    2552 scope.go:117] "RemoveContainer" containerID="61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e"
Jul 28 02:01:12.958374 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.958357    2552 scope.go:117] "RemoveContainer" containerID="35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652"
Jul 28 02:01:12.967411 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.967192    2552 scope.go:117] "RemoveContainer" containerID="61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e"
Jul 28 02:01:12.967570 ip-10-0-137-121 kubenswrapper[2552]: E0728 02:01:12.967540    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e\": container with ID starting with 61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e not found: ID does not exist" containerID="61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e"
Jul 28 02:01:12.967696 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.967578    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e"} err="failed to get container status \"61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e\": rpc error: code = NotFound desc = could not find container \"61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e\": container with ID starting with 61db7c16d6a3717c37920d0f75f72ba5ce389d72779f5596471e77378d7a1d7e not found: ID does not exist"
Jul 28 02:01:12.967696 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.967602    2552 scope.go:117] "RemoveContainer" containerID="35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652"
Jul 28 02:01:12.967991 ip-10-0-137-121 kubenswrapper[2552]: E0728 02:01:12.967887    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652\": container with ID starting with 35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652 not found: ID does not exist" containerID="35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652"
Jul 28 02:01:12.967991 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.967919    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652"} err="failed to get container status \"35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652\": rpc error: code = NotFound desc = could not find container \"35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652\": container with ID starting with 35998c89b886b3ee28a35486798da6a96b9873cf5e17c1f156e5f0b4e7955652 not found: ID does not exist"
Jul 28 02:01:12.970455 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.970436    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"]
Jul 28 02:01:12.974051 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:12.974027    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0337e8-openshift-default-85b7858cb4-cz76p"]
Jul 28 02:01:14.022655 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:14.022622    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" path="/var/lib/kubelet/pods/ad076bb7-da7c-4ff2-a3f9-f9572fb3f363/volumes"
Jul 28 02:01:17.647159 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:17.647033    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:17.712674 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:17.712635    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:17.830042 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:17.830007    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:17.897238 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:17.897154    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:18.227703 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:18.227627    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:24.129481 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:24.129444    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:24.232665 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:24.232633    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:24.394648 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:24.394618    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"]
Jul 28 02:01:24.394849 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:24.394823    2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy" containerID="cri-o://737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347" gracePeriod=30
Jul 28 02:01:24.422610 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:24.422573    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:24.629889 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:24.629843    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:25.015480 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:25.015444    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56cc9f6f8f-zt94p_66bc17ec-ac0d-42ea-bc69-61bcf93c09bd/authorino/0.log"
Jul 28 02:01:25.762376 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:25.762341    2552 patch_prober.go:28] interesting pod/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 02:01:25.762784 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:25.762418    2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 02:01:29.666591 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.666519    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 02:01:29.835587 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.835544    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-socket\") pod \"49330d0e-11d8-4595-b483-35a2f79143fa\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") "
Jul 28 02:01:29.835774 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.835633    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc79t\" (UniqueName: \"kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-kube-api-access-sc79t\") pod \"49330d0e-11d8-4595-b483-35a2f79143fa\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") "
Jul 28 02:01:29.835774 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.835665    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49330d0e-11d8-4595-b483-35a2f79143fa-istiod-ca-cert\") pod \"49330d0e-11d8-4595-b483-35a2f79143fa\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") "
Jul 28 02:01:29.835774 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.835694    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-data\") pod \"49330d0e-11d8-4595-b483-35a2f79143fa\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") "
Jul 28 02:01:29.835774 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.835724    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-istio-token\") pod \"49330d0e-11d8-4595-b483-35a2f79143fa\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") "
Jul 28 02:01:29.835774 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.835773    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-credential-socket\") pod \"49330d0e-11d8-4595-b483-35a2f79143fa\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") "
Jul 28 02:01:29.836003 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.835817    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-certs\") pod \"49330d0e-11d8-4595-b483-35a2f79143fa\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") "
Jul 28 02:01:29.836003 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.835843    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-envoy\") pod \"49330d0e-11d8-4595-b483-35a2f79143fa\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") "
Jul 28 02:01:29.836003 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.835869    2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49330d0e-11d8-4595-b483-35a2f79143fa-istio-podinfo\") pod \"49330d0e-11d8-4595-b483-35a2f79143fa\" (UID: \"49330d0e-11d8-4595-b483-35a2f79143fa\") "
Jul 28 02:01:29.836003 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.835890    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49330d0e-11d8-4595-b483-35a2f79143fa" (UID: "49330d0e-11d8-4595-b483-35a2f79143fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:29.836246 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.836163    2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:29.836246 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.836164    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49330d0e-11d8-4595-b483-35a2f79143fa" (UID: "49330d0e-11d8-4595-b483-35a2f79143fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:29.836246 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.836173    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49330d0e-11d8-4595-b483-35a2f79143fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49330d0e-11d8-4595-b483-35a2f79143fa" (UID: "49330d0e-11d8-4595-b483-35a2f79143fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 02:01:29.836246 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.836183    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49330d0e-11d8-4595-b483-35a2f79143fa" (UID: "49330d0e-11d8-4595-b483-35a2f79143fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:29.836894 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.836862    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "49330d0e-11d8-4595-b483-35a2f79143fa" (UID: "49330d0e-11d8-4595-b483-35a2f79143fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:29.838188 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.838158    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "49330d0e-11d8-4595-b483-35a2f79143fa" (UID: "49330d0e-11d8-4595-b483-35a2f79143fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:01:29.838188 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.838171    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-kube-api-access-sc79t" (OuterVolumeSpecName: "kube-api-access-sc79t") pod "49330d0e-11d8-4595-b483-35a2f79143fa" (UID: "49330d0e-11d8-4595-b483-35a2f79143fa"). InnerVolumeSpecName "kube-api-access-sc79t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 02:01:29.838349 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.838296    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49330d0e-11d8-4595-b483-35a2f79143fa" (UID: "49330d0e-11d8-4595-b483-35a2f79143fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 02:01:29.838349 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.838330    2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49330d0e-11d8-4595-b483-35a2f79143fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49330d0e-11d8-4595-b483-35a2f79143fa" (UID: "49330d0e-11d8-4595-b483-35a2f79143fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 02:01:29.937406 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.937315    2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc79t\" (UniqueName: \"kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-kube-api-access-sc79t\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:29.937406 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.937346    2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49330d0e-11d8-4595-b483-35a2f79143fa-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:29.937406 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.937356    2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:29.937406 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.937364    2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49330d0e-11d8-4595-b483-35a2f79143fa-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:29.937406 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.937372    2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:29.937406 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.937380    2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:29.937406 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.937390    2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49330d0e-11d8-4595-b483-35a2f79143fa-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:29.937406 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:29.937397    2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49330d0e-11d8-4595-b483-35a2f79143fa-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Jul 28 02:01:30.053282 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.053246    2552 generic.go:356] "Generic (PLEG): container finished" podID="49330d0e-11d8-4595-b483-35a2f79143fa" containerID="737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347" exitCode=0
Jul 28 02:01:30.053442 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.053289    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" event={"ID":"49330d0e-11d8-4595-b483-35a2f79143fa","Type":"ContainerDied","Data":"737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347"}
Jul 28 02:01:30.053442 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.053334    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx" event={"ID":"49330d0e-11d8-4595-b483-35a2f79143fa","Type":"ContainerDied","Data":"9f974783f219220cc0ced690d4fe22d7b141ef1c3a3b8ffa9a49471a660f56fb"}
Jul 28 02:01:30.053442 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.053357    2552 scope.go:117] "RemoveContainer" containerID="737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347"
Jul 28 02:01:30.053442 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.053295    2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"
Jul 28 02:01:30.062766 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.062731    2552 scope.go:117] "RemoveContainer" containerID="b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470"
Jul 28 02:01:30.070907 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.070881    2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"]
Jul 28 02:01:30.071885 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.071863    2552 scope.go:117] "RemoveContainer" containerID="737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347"
Jul 28 02:01:30.072202 ip-10-0-137-121 kubenswrapper[2552]: E0728 02:01:30.072182    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347\": container with ID starting with 737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347 not found: ID does not exist" containerID="737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347"
Jul 28 02:01:30.072282 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.072210    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347"} err="failed to get container status \"737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347\": rpc error: code = NotFound desc = could not find container \"737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347\": container with ID starting with 737d9d8c79a82194ffed40897cf827da870187bb5f388d1ee33fc20dccf2f347 not found: ID does not exist"
Jul 28 02:01:30.072282 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.072226    2552 scope.go:117] "RemoveContainer" containerID="b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470"
Jul 28 02:01:30.072486 ip-10-0-137-121 kubenswrapper[2552]: E0728 02:01:30.072462    2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470\": container with ID starting with b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470 not found: ID does not exist" containerID="b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470"
Jul 28 02:01:30.072526 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.072493    2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470"} err="failed to get container status \"b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470\": rpc error: code = NotFound desc = could not find container \"b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470\": container with ID starting with b353fb8e98531242ae08b3ab8d8f7e31dfd3061453b44ab4fb5f5a1fa657a470 not found: ID does not exist"
Jul 28 02:01:30.077888 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.077862    2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-44b320-openshift-default-59b68f4dd-tklcx"]
Jul 28 02:01:30.229734 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.229650    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dkqzc_e0d3aa61-9015-49b0-bf02-f996f1d58b7c/manager/0.log"
Jul 28 02:01:30.340544 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.340514    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mtjx9_841cc1e8-49b1-416a-8f74-ee981f908cff/manager/0.log"
Jul 28 02:01:30.455484 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.455452    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58449fbb64-clm4k_30280f81-8595-4075-97c8-9ac8066aa5da/manager/0.log"
Jul 28 02:01:30.565482 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.565404    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9hhzc_46a8aa6a-e4c4-4b95-9c5b-f77e15107c21/server/0.log"
Jul 28 02:01:30.682578 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.682547    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8tnkc_ad44e239-4ad8-4187-9b57-0265a0b1b75f/manager/0.log"
Jul 28 02:01:30.924055 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.924027    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n_9371e3b4-8749-4120-91bd-d3be13cd4812/copy-manifests/0.log"
Jul 28 02:01:30.931170 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:30.931125    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n_9371e3b4-8749-4120-91bd-d3be13cd4812/manager/0.log"
Jul 28 02:01:31.504861 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:31.504825    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753370-7znv4_684c5e7c-d3ab-4d2c-bffd-33bad9ec7a24/cleanup/0.log"
Jul 28 02:01:31.825152 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:31.825062    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-c57j6_09c77ebf-4e15-4580-9aa3-01fec73672f6/postgres/0.log"
Jul 28 02:01:32.023670 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.023637    2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" path="/var/lib/kubelet/pods/49330d0e-11d8-4595-b483-35a2f79143fa/volumes"
Jul 28 02:01:32.563342 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.563308    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v_d93067be-5cd0-469a-8fbc-49ec9f06c387/util/0.log"
Jul 28 02:01:32.570426 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.570401    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v_d93067be-5cd0-469a-8fbc-49ec9f06c387/pull/0.log"
Jul 28 02:01:32.576515 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.576494    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v_d93067be-5cd0-469a-8fbc-49ec9f06c387/extract/0.log"
Jul 28 02:01:32.686049 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.686022    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj_493d7ebf-91b6-4b03-a84e-5e37f3e66fab/util/0.log"
Jul 28 02:01:32.693837 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.693809    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj_493d7ebf-91b6-4b03-a84e-5e37f3e66fab/pull/0.log"
Jul 28 02:01:32.700263 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.700212    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj_493d7ebf-91b6-4b03-a84e-5e37f3e66fab/extract/0.log"
Jul 28 02:01:32.808405 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.808377    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w_943ac80b-ebf1-4ba4-8852-328b4102f668/util/0.log"
Jul 28 02:01:32.817562 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.817501    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w_943ac80b-ebf1-4ba4-8852-328b4102f668/pull/0.log"
Jul 28 02:01:32.824314 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.824290    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w_943ac80b-ebf1-4ba4-8852-328b4102f668/extract/0.log"
Jul 28 02:01:32.930438 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.930404    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n_4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe/extract/0.log"
Jul 28 02:01:32.936107 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.936087    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n_4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe/util/0.log"
Jul 28 02:01:32.941793 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:32.941776    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n_4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe/pull/0.log"
Jul 28 02:01:33.056668 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:33.056637    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56cc9f6f8f-zt94p_66bc17ec-ac0d-42ea-bc69-61bcf93c09bd/authorino/0.log"
Jul 28 02:01:33.164530 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:33.164503    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cxpr4_140701c5-f4ae-413a-9f16-6a751e39e72e/manager/0.log"
Jul 28 02:01:33.275587 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:33.275563    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ll4mk_ef2c6eac-9fc7-4685-a85c-a015cd2b0f22/manager/0.log"
Jul 28 02:01:33.497688 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:33.497608    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2gcr9_ea4b4654-54bd-4c8f-a59f-9660765e9438/registry-server/0.log"
Jul 28 02:01:33.848574 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:33.848494    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h2ld5_07dee455-ce1d-4dee-b3a0-2ef36b0b52e9/manager/0.log"
Jul 28 02:01:34.179776 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:34.179753    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh_557b37fe-41fc-4ad6-a4ad-c24b1856986d/istio-proxy/0.log"
Jul 28 02:01:34.405873 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:34.405838    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f6ffdb965-ld6k8_ee9d9343-b2d2-4d42-a76f-a8093adb4dba/kube-auth-proxy/0.log"
Jul 28 02:01:34.638624 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:34.638589    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zp4fd_8328a25c-7f2b-48bd-a2aa-77de4de41a1d/istio-proxy/1.log"
Jul 28 02:01:34.760780 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:34.760748    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qvcbl_1b0b503d-4082-4ad2-a360-ec9f6c090f04/payload-pre-processing/0.log"
Jul 28 02:01:34.875194 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:34.875162    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ps9zc_48e1355a-db6d-41a2-bb00-e6963d587e74/payload-processing/0.log"
Jul 28 02:01:35.320982 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:35.320950    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lrnmf_77089b11-2755-494c-a1a9-6d6dd8ad4471/main/0.log"
Jul 28 02:01:35.539808 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:35.539764    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-qqt8s_3ca98f87-98ca-4c1e-b769-5f7b7eb2f053/main/0.log"
Jul 28 02:01:41.515719 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.515678    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pzk5p/must-gather-kf94l"]
Jul 28 02:01:41.516231 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516175    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy"
Jul 28 02:01:41.516231 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516192    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy"
Jul 28 02:01:41.516231 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516208    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy"
Jul 28 02:01:41.516231 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516214    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy"
Jul 28 02:01:41.516231 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516226    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy"
Jul 28 02:01:41.516231 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516232    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516238    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516243    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516256    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516261    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516275    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516281    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516290    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516295    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516354    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516363    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516373    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516380    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516387    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516393    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="557b8df0-cce9-4fe7-b878-b604db88087f" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516400    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy"
Jul 28 02:01:41.516436 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516406    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy"
Jul 28 02:01:41.516928 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516467    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy"
Jul 28 02:01:41.516928 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516472    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b46608c-6cd9-4351-850c-d0c114a9843a" containerName="istio-proxy"
Jul 28 02:01:41.516928 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516492    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy"
Jul 28 02:01:41.516928 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516497    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy"
Jul 28 02:01:41.516928 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516505    2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy"
Jul 28 02:01:41.516928 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516510    2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd9eb97a-5680-46cc-b4b4-c24b37a3123c" containerName="istio-proxy"
Jul 28 02:01:41.516928 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516575    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad076bb7-da7c-4ff2-a3f9-f9572fb3f363" containerName="istio-proxy"
Jul 28 02:01:41.516928 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.516584    2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="49330d0e-11d8-4595-b483-35a2f79143fa" containerName="istio-proxy"
Jul 28 02:01:41.518918 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.518904    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzk5p/must-gather-kf94l"
Jul 28 02:01:41.522377 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.522357    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pzk5p\"/\"kube-root-ca.crt\""
Jul 28 02:01:41.522472 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.522398    2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pzk5p\"/\"openshift-service-ca.crt\""
Jul 28 02:01:41.534808 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.534784    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pzk5p/must-gather-kf94l"]
Jul 28 02:01:41.540142 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.540105    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:41.540462 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.540442    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827-must-gather-output\") pod \"must-gather-kf94l\" (UID: \"bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827\") " pod="openshift-must-gather-pzk5p/must-gather-kf94l"
Jul 28 02:01:41.540527 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.540483    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wszx\" (UniqueName: \"kubernetes.io/projected/bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827-kube-api-access-8wszx\") pod \"must-gather-kf94l\" (UID: \"bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827\") " pod="openshift-must-gather-pzk5p/must-gather-kf94l"
Jul 28 02:01:41.608745 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.608707    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:41.641113 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.641084    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wszx\" (UniqueName: \"kubernetes.io/projected/bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827-kube-api-access-8wszx\") pod \"must-gather-kf94l\" (UID: \"bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827\") " pod="openshift-must-gather-pzk5p/must-gather-kf94l"
Jul 28 02:01:41.641246 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.641224    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827-must-gather-output\") pod \"must-gather-kf94l\" (UID: \"bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827\") " pod="openshift-must-gather-pzk5p/must-gather-kf94l"
Jul 28 02:01:41.641536 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.641521    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827-must-gather-output\") pod \"must-gather-kf94l\" (UID: \"bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827\") " pod="openshift-must-gather-pzk5p/must-gather-kf94l"
Jul 28 02:01:41.649730 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.649708    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wszx\" (UniqueName: \"kubernetes.io/projected/bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827-kube-api-access-8wszx\") pod \"must-gather-kf94l\" (UID: \"bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827\") " pod="openshift-must-gather-pzk5p/must-gather-kf94l"
Jul 28 02:01:41.828288 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.828193    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzk5p/must-gather-kf94l"
Jul 28 02:01:41.964579 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.964555    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pzk5p/must-gather-kf94l"]
Jul 28 02:01:41.966254 ip-10-0-137-121 kubenswrapper[2552]: W0728 02:01:41.966230    2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb7f8244_cb57_4b63_9b2f_b0ce1d8c8827.slice/crio-6e5ce51f3328bb84770f4918f06ebc54db5866f1076d19f5e0a66eeeae152dab WatchSource:0}: Error finding container 6e5ce51f3328bb84770f4918f06ebc54db5866f1076d19f5e0a66eeeae152dab: Status 404 returned error can't find the container with id 6e5ce51f3328bb84770f4918f06ebc54db5866f1076d19f5e0a66eeeae152dab
Jul 28 02:01:41.968021 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:41.968003    2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 02:01:42.122653 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:42.122561    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzk5p/must-gather-kf94l" event={"ID":"bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827","Type":"ContainerStarted","Data":"6e5ce51f3328bb84770f4918f06ebc54db5866f1076d19f5e0a66eeeae152dab"}
Jul 28 02:01:44.137476 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:44.137438    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzk5p/must-gather-kf94l" event={"ID":"bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827","Type":"ContainerStarted","Data":"a578240149a75f89a0476e27278e9a3a95480d1b648f64252286a6e557d79904"}
Jul 28 02:01:44.137476 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:44.137480    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzk5p/must-gather-kf94l" event={"ID":"bb7f8244-cb57-4b63-9b2f-b0ce1d8c8827","Type":"ContainerStarted","Data":"620e78ea23bbcaeeaa7caa8be998060fb59b1369cb68d75c76230f959d677c22"}
Jul 28 02:01:44.156189 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:44.156098    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pzk5p/must-gather-kf94l" podStartSLOduration=1.450547085 podStartE2EDuration="3.156075012s" totalImagesPullingTime="1.705527927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 02:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:01:44.154346359 +0000 UTC m=+3436.768654460" watchObservedRunningTime="2026-07-28 02:01:44.156075012 +0000 UTC m=+3436.770383085"
Jul 28 02:01:45.347489 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:45.347455    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vlsb4_7b3855d2-11ab-4755-b1a8-8c04ed3bab7e/global-pull-secret-syncer/0.log"
Jul 28 02:01:45.400937 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:45.400901    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log"
Jul 28 02:01:45.510494 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:45.510466    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-121.ec2.internal_5335f321bbdc98b925d1a74da4b1481d/haproxy/0.log"
Jul 28 02:01:47.447264 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:47.447232    2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5shbb_f5036ccb-ced6-4454-8216-7a43d1f73774/konnectivity-agent/0.log" limit=1024
Jul 28 02:01:50.658903 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.658845    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v_d93067be-5cd0-469a-8fbc-49ec9f06c387/extract/0.log"
Jul 28 02:01:50.684373 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.684346    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v_d93067be-5cd0-469a-8fbc-49ec9f06c387/util/0.log"
Jul 28 02:01:50.712468 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.712425    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hrw5v_d93067be-5cd0-469a-8fbc-49ec9f06c387/pull/0.log"
Jul 28 02:01:50.756337 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.756302    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj_493d7ebf-91b6-4b03-a84e-5e37f3e66fab/extract/0.log"
Jul 28 02:01:50.783160 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.783106    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj_493d7ebf-91b6-4b03-a84e-5e37f3e66fab/util/0.log"
Jul 28 02:01:50.812958 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.812912    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xfspj_493d7ebf-91b6-4b03-a84e-5e37f3e66fab/pull/0.log"
Jul 28 02:01:50.843349 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.843322    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w_943ac80b-ebf1-4ba4-8852-328b4102f668/extract/0.log"
Jul 28 02:01:50.866969 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.866939    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w_943ac80b-ebf1-4ba4-8852-328b4102f668/util/0.log"
Jul 28 02:01:50.893648 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.893600    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739hb4w_943ac80b-ebf1-4ba4-8852-328b4102f668/pull/0.log"
Jul 28 02:01:50.926777 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.926692    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n_4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe/extract/0.log"
Jul 28 02:01:50.950522 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.950494    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n_4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe/util/0.log"
Jul 28 02:01:50.980924 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:50.980884    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef16cs4n_4ebabf26-ea92-4d0b-8bbc-81fe7f3648fe/pull/0.log"
Jul 28 02:01:51.484169 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:51.483808    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-56cc9f6f8f-zt94p_66bc17ec-ac0d-42ea-bc69-61bcf93c09bd/authorino/0.log"
Jul 28 02:01:51.519207 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:51.519174    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cxpr4_140701c5-f4ae-413a-9f16-6a751e39e72e/manager/0.log"
Jul 28 02:01:51.563326 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:51.563299    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-ll4mk_ef2c6eac-9fc7-4685-a85c-a015cd2b0f22/manager/0.log"
Jul 28 02:01:51.691349 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:51.691312    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2gcr9_ea4b4654-54bd-4c8f-a59f-9660765e9438/registry-server/0.log"
Jul 28 02:01:51.964204 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:51.963692    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-h2ld5_07dee455-ce1d-4dee-b3a0-2ef36b0b52e9/manager/0.log"
Jul 28 02:01:53.582350 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:53.582315    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d/alertmanager/0.log"
Jul 28 02:01:53.609004 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:53.608979    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d/config-reloader/0.log"
Jul 28 02:01:53.632596 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:53.632549    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d/kube-rbac-proxy-web/0.log"
Jul 28 02:01:53.656337 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:53.656303    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d/kube-rbac-proxy/0.log"
Jul 28 02:01:53.679708 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:53.679677    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d/kube-rbac-proxy-metric/0.log"
Jul 28 02:01:53.702517 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:53.702488    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d/prom-label-proxy/0.log"
Jul 28 02:01:53.727864 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:53.727816    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b20a5a5-c0cb-4fb6-b441-c12301bc4e9d/init-config-reloader/0.log"
Jul 28 02:01:54.035002 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:54.034969    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2tnc6_bdea7eda-331d-4f63-92cf-9769af8ce7ba/node-exporter/0.log"
Jul 28 02:01:54.058581 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:54.058557    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2tnc6_bdea7eda-331d-4f63-92cf-9769af8ce7ba/kube-rbac-proxy/0.log"
Jul 28 02:01:54.081820 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:54.081786    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2tnc6_bdea7eda-331d-4f63-92cf-9769af8ce7ba/init-textfile/0.log"
Jul 28 02:01:54.851884 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:54.851857    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b4f8588b9-7dsxr_72a0effb-5ae4-4969-b35c-0662ef863734/thanos-query/0.log"
Jul 28 02:01:54.889474 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:54.889447    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b4f8588b9-7dsxr_72a0effb-5ae4-4969-b35c-0662ef863734/kube-rbac-proxy-web/0.log"
Jul 28 02:01:54.925738 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:54.925677    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b4f8588b9-7dsxr_72a0effb-5ae4-4969-b35c-0662ef863734/kube-rbac-proxy/0.log"
Jul 28 02:01:54.959097 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:54.959063    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b4f8588b9-7dsxr_72a0effb-5ae4-4969-b35c-0662ef863734/prom-label-proxy/0.log"
Jul 28 02:01:54.995491 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:54.995440    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b4f8588b9-7dsxr_72a0effb-5ae4-4969-b35c-0662ef863734/kube-rbac-proxy-rules/0.log"
Jul 28 02:01:55.031427 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:55.031360    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b4f8588b9-7dsxr_72a0effb-5ae4-4969-b35c-0662ef863734/kube-rbac-proxy-metrics/0.log"
Jul 28 02:01:56.121338 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.121311    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-mmzvs_9f762ba3-b1ff-44f4-946f-c7cc94e9f70b/networking-console-plugin/0.log"
Jul 28 02:01:56.561986 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.561935    2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"]
Jul 28 02:01:56.567811 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.567783    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.570441 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.570410    2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pzk5p\"/\"default-dockercfg-wjwmd\""
Jul 28 02:01:56.576445 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.576421    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"]
Jul 28 02:01:56.605729 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.605693    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-sys\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.605729 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.605736    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-proc\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.605927 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.605868    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-podres\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.605927 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.605903    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tmc4\" (UniqueName: \"kubernetes.io/projected/1ca07085-838f-4804-af16-e618d1d9af55-kube-api-access-6tmc4\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.605998 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.605928    2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-lib-modules\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.707387 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.707350    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-podres\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.707595 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.707421    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tmc4\" (UniqueName: \"kubernetes.io/projected/1ca07085-838f-4804-af16-e618d1d9af55-kube-api-access-6tmc4\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.707595 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.707455    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-lib-modules\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.707595 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.707492    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-sys\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.707595 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.707522    2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-proc\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.707595 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.707555    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-podres\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.707861 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.707634    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-proc\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.707861 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.707763    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-sys\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.707861 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.707840    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ca07085-838f-4804-af16-e618d1d9af55-lib-modules\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.717893 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.717851    2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tmc4\" (UniqueName: \"kubernetes.io/projected/1ca07085-838f-4804-af16-e618d1d9af55-kube-api-access-6tmc4\") pod \"perf-node-gather-daemonset-vwkdm\" (UID: \"1ca07085-838f-4804-af16-e618d1d9af55\") " pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:56.885880 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:56.885846    2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:57.061243 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:57.061209    2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"]
Jul 28 02:01:57.255213 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:57.255176    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm" event={"ID":"1ca07085-838f-4804-af16-e618d1d9af55","Type":"ContainerStarted","Data":"0db463b73fb3f78a9df10eaf04c57e227fefbb0416971279351d4ab44fcdf9e3"}
Jul 28 02:01:57.255213 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:57.255231    2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm" event={"ID":"1ca07085-838f-4804-af16-e618d1d9af55","Type":"ContainerStarted","Data":"376bfca1c8af1611c75d8765d1e7a98a657c7a5d57db7297abeaed11ddfc8770"}
Jul 28 02:01:57.255782 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:57.255256    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:01:57.275582 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:57.275518    2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm" podStartSLOduration=1.275495287 podStartE2EDuration="1.275495287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 02:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 02:01:57.27054152 +0000 UTC m=+3449.884849593" watchObservedRunningTime="2026-07-28 02:01:57.275495287 +0000 UTC m=+3449.889803360"
Jul 28 02:01:58.914019 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:58.913988    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwt7t_14f3bcef-9b2a-4664-9f55-d39a858cd433/dns/0.log"
Jul 28 02:01:58.937287 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:58.937253    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pwt7t_14f3bcef-9b2a-4664-9f55-d39a858cd433/kube-rbac-proxy/0.log"
Jul 28 02:01:59.035455 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:59.035421    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jr95w_49fb854d-b686-4dc6-acc0-0e3c17a1fae1/dns-node-resolver/0.log"
Jul 28 02:01:59.592020 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:59.591987    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b57d68984-5t4kr_17539a90-1dd8-4e74-a3bc-09dbfcd42049/registry/0.log"
Jul 28 02:01:59.608211 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:59.608179    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b57d68984-5t4kr_17539a90-1dd8-4e74-a3bc-09dbfcd42049/registry/1.log"
Jul 28 02:01:59.654495 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:01:59.654449    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fsnhz_b78c0dba-b7d9-4361-95f2-c0990578e1e6/node-ca/0.log"
Jul 28 02:02:00.629641 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:00.629594    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh_557b37fe-41fc-4ad6-a4ad-c24b1856986d/istio-proxy/0.log"
Jul 28 02:02:00.802816 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:00.802789    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f6ffdb965-ld6k8_ee9d9343-b2d2-4d42-a76f-a8093adb4dba/kube-auth-proxy/0.log"
Jul 28 02:02:00.859311 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:00.859283    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zp4fd_8328a25c-7f2b-48bd-a2aa-77de4de41a1d/istio-proxy/0.log"
Jul 28 02:02:00.895891 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:00.895857    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zp4fd_8328a25c-7f2b-48bd-a2aa-77de4de41a1d/istio-proxy/1.log"
Jul 28 02:02:00.930190 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:00.930160    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qvcbl_1b0b503d-4082-4ad2-a360-ec9f6c090f04/payload-pre-processing/0.log"
Jul 28 02:02:00.962292 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:00.962260    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ps9zc_48e1355a-db6d-41a2-bb00-e6963d587e74/payload-processing/0.log"
Jul 28 02:02:01.779627 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:01.779602    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dw9b8_b285aad5-dd32-4ce5-9dbd-7f6c66bade91/serve-healthcheck-canary/0.log"
Jul 28 02:02:02.396555 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:02.396526    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n4ksc_028634a0-3ead-4640-b4d8-fb8024c6ad8f/kube-rbac-proxy/0.log"
Jul 28 02:02:02.419223 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:02.419200    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n4ksc_028634a0-3ead-4640-b4d8-fb8024c6ad8f/exporter/0.log"
Jul 28 02:02:02.442845 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:02.442762    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n4ksc_028634a0-3ead-4640-b4d8-fb8024c6ad8f/extractor/0.log"
Jul 28 02:02:03.273176 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:03.273117    2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pzk5p/perf-node-gather-daemonset-vwkdm"
Jul 28 02:02:04.664447 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:04.664405    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dkqzc_e0d3aa61-9015-49b0-bf02-f996f1d58b7c/manager/0.log"
Jul 28 02:02:04.949728 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:04.949657    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mtjx9_841cc1e8-49b1-416a-8f74-ee981f908cff/manager/0.log"
Jul 28 02:02:05.162672 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:05.162634    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58449fbb64-clm4k_30280f81-8595-4075-97c8-9ac8066aa5da/manager/0.log"
Jul 28 02:02:05.187489 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:05.187454    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-9hhzc_46a8aa6a-e4c4-4b95-9c5b-f77e15107c21/server/0.log"
Jul 28 02:02:05.290574 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:05.290496    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-8tnkc_ad44e239-4ad8-4187-9b57-0265a0b1b75f/manager/0.log"
Jul 28 02:02:05.425841 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:05.425811    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n_9371e3b4-8749-4120-91bd-d3be13cd4812/manager/0.log"
Jul 28 02:02:05.448525 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:05.448498    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5bf98dfb-qfx4n_9371e3b4-8749-4120-91bd-d3be13cd4812/copy-manifests/0.log"
Jul 28 02:02:05.833309 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:05.833279    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh_557b37fe-41fc-4ad6-a4ad-c24b1856986d/istio-proxy/0.log"
Jul 28 02:02:05.998922 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:05.998889    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f6ffdb965-ld6k8_ee9d9343-b2d2-4d42-a76f-a8093adb4dba/kube-auth-proxy/0.log"
Jul 28 02:02:06.044662 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:06.044627    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zp4fd_8328a25c-7f2b-48bd-a2aa-77de4de41a1d/istio-proxy/0.log"
Jul 28 02:02:06.075793 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:06.075666    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zp4fd_8328a25c-7f2b-48bd-a2aa-77de4de41a1d/istio-proxy/1.log"
Jul 28 02:02:06.100523 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:06.100478    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qvcbl_1b0b503d-4082-4ad2-a360-ec9f6c090f04/payload-pre-processing/0.log"
Jul 28 02:02:06.124095 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:06.124065    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ps9zc_48e1355a-db6d-41a2-bb00-e6963d587e74/payload-processing/0.log"
Jul 28 02:02:07.609902 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:07.609864    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-29mzh_557b37fe-41fc-4ad6-a4ad-c24b1856986d/istio-proxy/0.log"
Jul 28 02:02:07.764702 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:07.764671    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f6ffdb965-ld6k8_ee9d9343-b2d2-4d42-a76f-a8093adb4dba/kube-auth-proxy/0.log"
Jul 28 02:02:07.822014 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:07.821978    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zp4fd_8328a25c-7f2b-48bd-a2aa-77de4de41a1d/istio-proxy/0.log"
Jul 28 02:02:07.867731 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:07.867635    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-zp4fd_8328a25c-7f2b-48bd-a2aa-77de4de41a1d/istio-proxy/1.log"
Jul 28 02:02:07.895916 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:07.895885    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-qvcbl_1b0b503d-4082-4ad2-a360-ec9f6c090f04/payload-pre-processing/0.log"
Jul 28 02:02:07.924154 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:07.923372    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-ps9zc_48e1355a-db6d-41a2-bb00-e6963d587e74/payload-processing/0.log"
Jul 28 02:02:11.869913 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:11.869883    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-9gljp_5e00b90f-64a6-471a-b777-099da6e039d5/migrator/0.log"
Jul 28 02:02:11.891253 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:11.891211    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-9gljp_5e00b90f-64a6-471a-b777-099da6e039d5/graceful-termination/0.log"
Jul 28 02:02:13.355287 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:13.355262    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8blwn_46d16632-292e-409c-a90d-931eb85e6e88/kube-multus-additional-cni-plugins/0.log"
Jul 28 02:02:13.377609 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:13.377584    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8blwn_46d16632-292e-409c-a90d-931eb85e6e88/egress-router-binary-copy/0.log"
Jul 28 02:02:13.401440 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:13.401410    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8blwn_46d16632-292e-409c-a90d-931eb85e6e88/cni-plugins/0.log"
Jul 28 02:02:13.431883 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:13.431848    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8blwn_46d16632-292e-409c-a90d-931eb85e6e88/bond-cni-plugin/0.log"
Jul 28 02:02:13.454100 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:13.454075    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8blwn_46d16632-292e-409c-a90d-931eb85e6e88/routeoverride-cni/0.log"
Jul 28 02:02:13.475822 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:13.475795    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8blwn_46d16632-292e-409c-a90d-931eb85e6e88/whereabouts-cni-bincopy/0.log"
Jul 28 02:02:13.498078 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:13.498053    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8blwn_46d16632-292e-409c-a90d-931eb85e6e88/whereabouts-cni/0.log"
Jul 28 02:02:13.855407 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:13.855378    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sb7r5_7485b6d6-5852-4818-a6aa-e85e9a6189a9/kube-multus/0.log"
Jul 28 02:02:13.976664 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:13.976629    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wj5vw_b55dc23e-8f3c-41ba-9d22-d3bd76112806/network-metrics-daemon/0.log"
Jul 28 02:02:13.995415 ip-10-0-137-121 kubenswrapper[2552]: I0728 02:02:13.995385    2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wj5vw_b55dc23e-8f3c-41ba-9d22-d3bd76112806/kube-rbac-proxy/0.log"